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October 17, 1989 



Phone: 614-292-4353 
Telex: 9102505950 
Fax: 614-292-1260 



Dear Colleague: 

On behalf of the Program Planning Committee and workshop Co- 
Directors, Robert E. Norton and Brian K. Hajek, I want to WELCOME 
you to Columbus, Ohio and the Center on Education and Training 
for Employment. This national workshop is being conducted in 
cooperation with the Midwest Nuclear Training Association, 
the Nuclear Engineering Program at The Ohio state University, 
and the National Academy for r-Tuclear Training. This comprehen- 
sive, 2-day workshop is designed to provide training pe^.-onnel 
from the electric power industry with an opportunity to expand 
and improve their knowledge and skills in the development and 
implementation of effective training programs. 

Every effort has been made to make this an enjoyable and produc- 
tive educational learning experience. You will have ample oppor- 
tunity to share your ideas and concerns with fellow participants 
and presenters throughout the next two days. We hope upon con- 
clusion of this program you will leave with new strategies, 
techniques, and resources for use in your company. 

Sincerely, 



Scot Krause 
Program Coordinator 
Center on Education and 
Training for Employment 
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WORKSHOP OBJECTIVES 

You Will Learn How To — 

o Acquire some new instructional skills 

o Enhance instructional skills already possessed 

o Keep Abreast of changing industry standards and 
- regulations 

o Keep Abreast of changing industry accreditation require- 
ments and training guidelines 

You Will Also Have The Opportunity To — 

o Network with recognized industry experts on selected 
topics and issues 

o Interact with other nuclear training professionals 

o Promote Professionalism, Safety, and Excellence within 
the electric utility industry 



MNTA WORKSHOP PLANNING COMMITTEE 



Ronald J. Bruno, Superintendent of Training, Wisconsin Electric 
Power Company 

Brian K, Hajek, Research Scientist, Nuclear Engineering Program 
Thft Ohio State University 

Greg R. Hossbach, Program Development Administrator, Commonwealth 
Edison CoTipany 

Dave Igyarto, Training Manager, Cleveland Electric Illuminating 

Robert E. Norton, Consortium Manager, Center on Education and 
Training for Employment, The Ohio State University 

Rick A. Simpkins, Training Manager, Nuclear Operations, Toledo 
Edison 
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MNTA FOURTIi "^NNU^^L 
NUCLEAR INSTRUCIORS • WORKSHOP 

October 16-18 r 1989 
Ohio Center-Holiday Inn 
ColxizDbus, Ohio 



WORKSHOP PROGRAM 



Monday, October 16, 1989 
7:00-10:00 p.m. 



Get Acquainted Social 
Ohio Center-Holiday Inn 
Hosted by CORE — Pat Casey 



Tuesday, October 17, 1989 

7:30 a.m. Workshop Registration 

8:30 a.m. OPENING GENERAL SESSION 



Welcome , Introductions , and Orientation 
to Workshop Program 

Robert E. Norton 
Consortium Director 
Center on Education and Training 
for Employment 

Brian K. Hajek 
Research Scientist 
Nuclear Engineering Program 
The Ohio State University 

8:45 a.m. Opening Remarks 

Dave Igyarto 

MNTA Vice-chairman and Training Manager 
Cleveland Electric Illuminating 

8:55 a.m. NRC Initiatives for FY1990 



Tom Burdick 

Chief of Operator Licensing 
NRC, Region III 



Tuesday, October 17, 1989 (Continued) 



9:40 a.m. Preparing for Accreditation Renewal 

Ronald L. Fritchley 
Manager 

Training Systems Department 
Institute of Nuclear Power Operations 

10:25 a.m. Refreshment Break 

10:45 a.m. Panel Presentation: Developing 

Instructional Skills with Modularized 
Materials 



David Keck 

Instructional Trainer 
Duke Power and Light 

Jo Palchinsky 
Instructional Specialist 
Florida Power and Light 

Patrick Smith 

Training Systems Support Administrator 
Southern California Edison 



Dave Watson 

Nuclear Operations Training Academic 

Specialist 
Florida Power Corporation 



12:15 p.m. 



Buffet Luncheon 

Ohio Center-Holiday Inn 

Prefunction Area 



Tuesday, October 17, 1^89 (Continued) 



1:15-2:45 p.m. CONCURRENT WORKSHOP SESSIONS Select One 

(IJ Certifying Simulator Instructors — Riviera 

Jo Palchinsky, Nuclear Curriculum Specialist, Florida Power 
and Light 

Travel the development of FPL's Simulator Instructor Training 
Program from its first day of inception to current thinking 
including: its charter, analysis, naming "SQIOC", program 
design, trial implementation, and lessons learned. You will 
participate in an interactive discussion and challenge the 
SQIOC model. You will review the certification requirements 
and hov7 exercise guides incorporate instructor/student inter- 
face cues to drive simulator training. 



(2) Addressing Instructional Deficiencies via Continuing 
Training — Kingsmill 

Terry Pease, General Program Developer, Commonwealth Edison 

This presentation will discuss the process Commonwealth 
Edison Company follows to identify instructional presenta- 
tion weaknesses, correct these weaknesses, and feed this 
data into initial and continuing training. Documents to 
address this topic will be distributed. 



(3) Using Computer Technology to Enhance Instruction — Scioto 
Ron Comer, Director of Medical Computer Assisted Instruction 
Center, The Ohio State University 

Advanced instructional technology has gained rapid acceptance 
as an effective mechanism for delivering instruction. Stu- 
dent motivation is increased and a new sense of drama is 
introduced into the educational environment as students 
learn by actively engaging instructional content. Whether 
designed as a tutorial or a problem solving simulation ex- 
perience, each student proceeds through ti ^ instruction at 
his/her own pace, along a pathway tailored for his/her own 
unique background, obtaining either immediate or delayed 
feedback;, at a convenient time and location. The technology 
and instructional strategies demonstrated are examples from 
a medical environment but can be employed with equal 
effectiveness in any education or training situation. 



2:45 p.m. 



Refreshment Break 



Tuesday, October 17, 1989 (Continued) 



3:15-4:45 p.m. CONCURRENT WORKSHOP SESSIONS Select One 

(4) Evaluating Perforaance in '.Laboratory Training — Riviera 
Scott Stabler, Training Supervisor, Coininonwealth Edison 

By establishing a '"working" lab quality control program, 
training laboratories can solve two recurring problems. 
Trainee performance can be objectively evaluated by moni- 
toring the precision and accuracy of their analysis, and 
secondly, instructor qualifications can be evaluated, with 
their results forming the basis for instructor continuing 
education. 



(5) JPMs: Lessons Learned — Kingsmill 

Dave Dowker, Training Instructor, Toledo Edison Company 

Job Performance Measures form an intergral part of the new 
requalif ication exams. Everyone has had an opportunity to 
test the effectiveness of these new JPMs. The question is, 
"How do the JPMs of today compare with those of just a year 
ago?" CIRCLE ONE: BETTER. SAME. WORSE. 



(6) Facilitating Effective Group Interaction — Scioto 
William P. Werner, Manager of Management/Educational 
Development, GPU Nuclear Corporation 

During this workshop, participants will receive a generic 
model of group development. Then they will be given proven 
facilitative, team building techniques that help a group 
become effective quickly. Therefore, anyone who works with 
groups — Managers, Supervisors, Instructors — would benefit. 



4:45 p.m. Daily Feedback and Adjournment 

5:30-7:30 p.m. Crackerbarrel and Networking 

Ohio Center-Holiday Inn 

Hosted by GE Nuclear Training Services — 
Mike Price 
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Wednesday^ October 18, 1989 

8:00 a.m* Morning Refreshments and Conversation 

8:15 a.m. SECOND GENERAL SESSION 

Training Instructors: Keys To Nuclear 
Professionalism 

Walt Coakley 
Executive Director 

National Academy of Nuclear Training 

9:15 a.m. Professionalismr ASTD, and The 

Technical Trainer 

Gloria Ann Regalbuto 
National Board Member and President 
Elect 

American Society of Training and 
Development 

10:00 a.m. Refreshment Break 



ERIC 
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Wednesday, October 18, 1989 (Continued) 



10:30-12:00 noon CONCURRENT WORKSHOP SESSIONS Select One 

(7) Maintaining a Requal Exam Bank — Riviera 

Mark L. Mervine, Training Coordinator, Wisconsin Electric 
Power Company 

The purpose of this presentation will be to make nuclear 
trainers aware of the NRC maintenance requirements for the 
NRC Requal Exam Bank and to review the different possible 
methods of maintaining and keeping the exam book up-to-date ♦ 



(8) Critiquing Trainee Lat>oratory Performance — Kingsmill 
Greg Duncan, Senior Trainer, Toledo Edison Company 

A participant-centered discussion of how laboratory trainers 
can use formative and summative critiques to increase stu-- 
dent involvement in the learning process will be utilized 
in this workshop session. Through group interaction, the 
participants will generate a list of the five best tips for 
conducting critiques of laboratory performance. 



(9) Root Cause Analysis Training: An Introduction — Scioto 
Ken Crouch, Skills Training Coordinator, Cleveland 
Electric Illuminating 

This presentation will focus attention on the specific 
training needs for each work group. A gap exists between 
their unique needs and the generic training that many have 
received. You will learn how to bridge this gap by tailor- 
ing root cause analysis training to each work group. 



12:00 noon Buffet Luncheon 

Ohio center-Holiday Inn 
Prefunction Area 
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Wednesday^ Cctober 18, 1989 (Continued) 



1:00-2:30 p.m. CONCURRENT WORKSHOP SESSIONS Select One 

(10) Developing and Preparing for Static Simulator 
Training — Riviera 

Robert Svaleson, License Retraining Main Instructor, 
Commonwealth 3dison 

This session will take you through a review of ES-601 as it 
pertains to static simulator exam?. In addition, we will 
travel through the development process onto the presentation 
of an "A" section exam. 



(11) Devfiloping Positive Worker Behaviors: Techniques and 
Strategies That Work — Kingsmill 

Robert E. Norton, Consortium Manager, Center on Education 
and Training for Employment and Ronald L. Jacobs, Assistant 
Professor, The Ohio State University 

Worker attitudes and behaviors, like the weather, are things 
people talk about but too often don't do anything about. 
This presentation will deal with the affective (or forgotten) 
domain. There will be a discussion of some technigues and 
strategies for cultivating positive attitudes. For example, 
using self -managed work groups to improve productivity and 
job satisfaction at the Inlanc? Fisher-Guide Company will be 
reviewed. 



(12) Selection and Use of Media — Scioto 

Dewey V. Martin, Media Director, Instructional Materials 
Lab, College of Education, The Ohio State University 

The use of media can greatly enhance the quality of train- 
ing. This session will outline media choices and methods 
to determine which media (or medium) will work best for the 
training you are developing. Discussion will include print, 
video, computer, and interactive ^ideo. 



2:30 p.m. Refreshment Break 
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Wednesday, October 18, 1989 (Continued) 



3:00-4;30 p.m. CONCURRENT WORKSHOP SESSIONS Select One 

(13) Closing The Feedback Loop — Riviera 

Michael G* Price, Lead Certification Examiner, General 
Electric 

Relating available methods of feedback to new technology will 
give the individual learner more specific help. This new 
technology will also aid in training program improvement as 
well as methods for documentation. 



(14) Motivating Your Students in Class by Esl .blishing Yourself 
in Their Presence — Kingsmill 

Brian Hajek, President/Research Scientist, Nucle ir Educa- 
tion and Training Services, Inc./I^^e Ohio State University 

This presentation will focus on methods to project yourself 
in front of a class. It will discuss and practice proven 
methods to establish your presence at the front of the class- 
room, commanding the area; methods to make contact with your 
students; 'to actually become part of the class; and methods 
for effectively using illustrations, visuals, and props* 



(15) Improving The Quality of Operations — Scioto 

Thomas L, Fueston, Senior Training Advisor, Westinghouse 
Training and Operational Services 

The basis for the "Quality" in your day-to-day operations is 
dependent upon the Quality Values of the individuals and 
teams that comprise your organization. But how do you teach 
values? Defining Quality, why it is L^iportant, as well as 
what focusing on Quality can do for both the individual and 
the organization are the first steps toward gaining indivi- 
dual and team commitment to "Quality of Operations". 



4:30 p.m. Workshop Summary: Issues and 

Challenges Ahead 

Dave Igyarto 

MNTA Vice-chairman and Training Manager 
Cleveland Electric Illuminating 

4:45 p.m. Final Adjournment 
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Developing Positive Worker Behaviors: 
Techniques and Strategies That Work^ 



Robert E. Norton 
Senior Research and Development Specialist 
Center on Education and Training for Employment 
The Ohio State University 
Columbus, Ohio 43210 



Worker attitudes and behaviors, like the weather, are things people talk about but (too 
often) don't do anything about. We, as instructors, however, can teach behaviors and try to 
cultivate the undergirding attitudes. 

Worker attitudes and behaviors fall into the affective domain, as opposed to the cognitive 
or psychomotor domains. Educators have long been comfortable teaching cognitive knowledge 
(concepts, facts, principles, and generalizations) and psychomotor skills (performances that require 
the manipulation of objects, tools, supplies, and equipment). Some affective skills (attitudes and 
behaviors) have also been taught, albeit without the label (classroom/laboratory conduct). 



What Are Attitudes and Behaviors? 

. , . we believe that attitudes are internal states that influence behavior. We can infer these 
states from actions and words. (Martin and Briggs 1986, p. 101) 

Behavior is the external reflection of internal attitudes. Attitudes, of themselves, are 
impossible to measure directly, but behaviors are not. Attitudes can be influenced by external as 
well as internal factors. The teacher's role, then, is to provide explicitly stated expectations of 
behavior (external factors) that the student can understand. The student may acquire the external 
behavior faster than the internal attitudes or may never really "buy into" the internal attitude. This 
does not constitute "failure" on the part of the teacher. If the student knows the behavior that is 
expected of him/her, then it is up to the student to internalize or not. 

What, then, are the behaviors we should teach? The literature, unfortunately, is "...vast 
and diffuse, and the concept of attitude is confusing due to variations in both terminology and 
definitions" (Martin and Briggs 1986, p. 99). Chapter II will discuss the various ways people have 
grouped attitudes and behaviors. However, some of the behaviors that are frequently mentioned 
are — 

0 punctuality, o initiative, 

0 cooperativeness, o productivity, 

0 reliability, o honesty, 

0 courteousness, o flexibility, 

0 creativity, o ability to follow directions 

0 loyalty, o ability to accept criticism, and 

0 adaptability, o attendance 



Adapted from Norton, Robert E. and Kurth, Paula. Developing Positive Worker 
Behaviors in Vocational and Technical Students, Athens, GA: American Association for 
Vocational Instructional Materials, 1989. 
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Safety is also frequently listed as an attitude that is highly desirable in workers. A positive 
attitude toward implementing safe practices on the job is an aspect of worker preparation that 
must not be neglected. The above list is not, by any means, all-inclusive, but it does contain a 
representative sampling of behaviors. 

To also add to the confusion, behaviors are referred to in the literature and resource 
materials for teaching behaviors as ethical behaviors, affective behaviors, attitudinal skills, ethical 
characteristics, work maturity skills, values, attitudes, habits, employee attributes, affective job 
skills, employability skills, and nontechnical skills. Unless quoting from a source, this document 
will use the term "behavior." 

As instructors our job is to prepare trainees for their future roles. In industry, this means 
providing the worker with the skills necessary to succeed on the job. When we teach, we share 
knowledge and reinforce it through practice. We must teach not only the technical skills but also 
the behaviors that will make the workers more successful. 



Why Are Attitudes and Behaviors Important? 

When a supervisor describes a worker as having a "good attitude," it is not because that 
supervisor has read the worker's mind. It is probably because the supervisor has informally 
assessed the behaviors that have led him/her to that conclusion. If pressed for reasons why he/she 
holds that opinion, the supervisor will probably be able to respond with the criteria he/she used 
to measure the attitude. The criteria will be measures of behavior, such as attendance, 
assignments, and the enthusiasm the worker displays for tasks. 

Just as a good attitude and positive behaviors are necessary for a student to succeed in 
school, a good attitude and positive behaviors are necessary for a worker to succeed in a job. 
Employers are unanimous in desiring workers with good attitudes. In a study of 60 businesses that 
was conducted to determine the ". . . qualities that employers consider important in beginning 
skilled or semi-skilled employees" (Stevenson 1986, p. 3), employers were asked to rate various 
worker qualities as being "essential," "advantageous," "company will train," or "not required on the 
job." Of the ten qualities measured, which included basic mathematics and reading, only "positive 
work attitude" was rated as essential (40 employers) or advantageous (20 employers) by all the 
employers interviewed. 

Employers are very serious about desiring that their employees demonstrate positive 
attitudes. In a 1981 study. Beach found that 87 percent of terminations and refusals to promote 
employees were due to poor attitudes on the part of the worker as reflected in habits (behaviors). 
Oinonen (1984) also found that poor work attitudes and behaviors ". . . were unanimously 
identified by both employers and employees as the characteristics most frequently leading to recent 
graduates or dropouts losing their jobs" (p. 17). Lufts and Suzuki (1980) cite Klaurens' 1972 study, 
which also found that the principal reasons for job loss are not technical job skills, but, rather, 
the nontechnical skills. Lufts and Suzuki found that the four competencies most important to 
employers are promptness, honesty, use of time, and thoroughness. These competencies are 
behaviors that reflect attitudes. Grain's 1984 study of the quality of high school graduates as 
perceived by personnel officers indicates that dependability and proper attitudes of high school 
graduates are of greater concern to employers than grades or overall quality of the high school. 

Positive work attitudes, then, are exhibited via behaviors in the context of performing a 
cognitive or psychomotor task. As Mongo (1978) states: "Values are qualities, principles, or things 
regarded as desirable and are reflected in specific human behaviors" (p. 9). 

We, as instructors, may not be comfortable with changing values (attitudes) but we must 
teach our workers the behaviors that are valued and rewarded by employers, just as we would 
teach trainees the technical job skills valued and rewarded by employers. We may not be able to 



direotly modify and measure attitudes, but we can modify and measure behaviors, and we owe it 
to our trainees to do so. 



Some Research Findings 

Attitudes have been defined as . • internal states that influence behavior. We can infer 
these states from actions and words" (Martin and Briggs 1986, p. 101). Attitudes, then, are how 
we feel, and behaviors are the way we act on those feelings. Knowing what is appropriate and 
inappropriate behavior^ however, can affect the display of an attitude, that is, result in a different 
behavior than that which one might prefer to display. 

Both internal and external factors influence the development of attitudes. Internal factors 
include . . personality traits and structures, the brain, hormones and the nervous system, 
cognitive structures, mental states, types of attributions, undeveloped or underdeveloped moral 
systems or codes, and poor intellectual functioning" (Martin and Briggs 1986, p. 108). Some of 
these factors may be changed indirectly over time. As individual educators, we have neither the 
length of time with students nor, with regard to some of the factors, the specialized expertise or 
mission to enable us to directly influence or alter these factors. Thus, dealing with the internal 
factors that influence attitudes is not a productive nor sanctioned way for educators to proceed. 

This leaves us the external factors with which to work. The external factors that influence 
attitudes and resulting behaviors are more within our control. External factors include 
environmental or social influences (parental expectations, peer pressure)^ reinforcement, and 
modeling. By dealing cognitively with behaviors, that is, explicitly stating what behaviors are 
expected in different situations or settings, we offer the student the opportunity to meet 
expectations. Setting a good example ourselves gives workers a positive role model. Positive 
reinforcement can provide incentives to workers to display positive behaviors.^ 

Given the realities of ' iriances in worker backgrounds, susceptibility to peer pressure, and 
individual characteristics and ability to process and internalize, teaching positive work behaviors 
may not be easy. And, just as in teaching psychomotor skills, trainees will probably not master 
all the behaviors desired of a worker. The i^uestion, however, is not one of "Should we or 
shouldn't we?" but "How?" In the remainder of this paper we will discuss generalizable vs. 
occupation specific skills and instructional methods. 

Findings from Studies on Generalizable Skills. Should appropriate work behaviors be 
taught as a general set of competencies that cut across all occupations or do different occupations 
require different behaviors? Valid arguments exist to support both points of view. 

Kazanas (1978) reviewed, synthesized, and reported on what was known about the social 
and psychological aspects of work and identified and analyzed specific affective work competencies 
desirable and common for most vocational education programs. In the list below, numbers 1 
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Martin and Briggs (1986) offer an excellent overview and critique of attitude change 
theories that is relevant but tangential to the purpose of this document. 



through 31 were identified by both industry and educators, 32 through 41 were ;Hpnt;f;oH u 
industry, and 42 thr..ugh 63 were identified only by edVcators^^^ identified only by 



1. 
2. 
3. 
4. 
5. 
6. 
7. 



punctuality 
cooperativeness 
capability 
follows directions 
responsibility 
emotional stability 
initiative 
8. dependability 

10. helpfulness 

11. loyalty 

12. adaptability 

13. efficiency 

14. ambition 

15. quality of work 

16. dedication 

17. reliability 

18. accuracy 

19. perseverance 

20. judgment 

21. concentration 

22. carefulness 



23. 


cheerfulness 


44. 


24. 


enthusiasm 


45." 


25. 


independence 


46. 


26. 


quantity of work 


47. 


27. 


intelligence 


48. 


28. 


personal appearance 


49.' 


29. 


alertness 


50. 


30. 


devotion 


51. 


31. 


recognition 


52. 


32. 


leadership potential 


53." 


33. 


courtesy 




34. 


pleasantness 


55. 


35. 


responsiveness 


56. 


36. 


personality 


57. 


37. 


endurance 


58. 


38. 


tolerance 


59. 


39. 


shyness 


60. 


40. 


tender-mindedness 


61. 


41. 


overall job performance 


62. 


42. 


health 


63. 


43. 


creative 



consideration 

speed 

influence 

orderliness 

patience 

poise 

interest 

curiosity 

forcefulness 

activeness 

awareness 

resourcefulness 

appreciativeness 



compensation 



working conditions 
friendliness 



onH '^ll.^'^''''^'-^-^^'''? ^""^ Kazanas published a refined list, omitting items 59 through 62 
and grouped the remaining items into 15 clusters: mruugn oz. 



1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 
10. 
11. 
12. 
13. 
14. 
15. 



Ambitious 

Cooperative/helpful 

Adaptable/resourceful 

Considerate/courteous 

Independent/initiating 

Accurate/quality of work 

Careful/alert/perceptive 

Pleasant/friendly/cheerful 

Responsive/follows directions 

Emotionally stable/judging/poised 

Persevering/patient/enduring/toierant 

Neat/orderly/personal appearance/manner 

Dependable/punctual/reliable/responsible 

Efficient/quality of work/achieving/speedy 

Dedicated/devoted/honest/loyal/conscientious 



0 Accurate/quality of work 

works accurately regardless of importance of task 
makes few errors 

finishes work to a consistent, high standard 
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Adaptable/resourceful 



adjusts readily to different conditions 

adjusts to new or different time schedules, people, or responsibilities 
learns quickly 

is willing to try new procedures and ideas 
willing to learn more 
able to get along with a varie*'' of people 
seeks new ideas and ways of Ing things 
can devise a plan of action 

uses what is already known to do a new or different job 
Ambitious 

improves abilities to do job 

asks for additional assignments and tasks when time is available 

does extra work when necessary 

works extra time when necessary 

makes an effort to learn more 

maintains professional knowledge 

anticipates responsibilities on the job 

learns new job skills to get a different job or position 

Careful/alert/percepttve 

keeps work area orderly and safe from hazard 

reviews work to check for its accuracy 

writes neatly, legibly, and with correct spelling 

asks for help when necessary 

is particular about the finished product 

perceives alternatives and chooses among them 

Considerate/courteous 

responds to the needs of others 

makes a personal effort to improve conditions 

praises others for their accomplishments 

does something of value for others 

empathizes with the point of view of others 

uses good manners/is polite 

shows thoughtfulness toward others 

displays tact in dealing with difficult or delicate situations 

Cooperative/helpful 

works cooperatively with others 
shares materials 
shares information 
shares ideas 

asks if others need help 

is helpful to others 

does not criticize others unnecessarily 

gets along with co-workers 

cooperates with organization and union to resolve conflicts 



gets support from others to change things that need changing 
compromises when appropriate 
shares information and knowledge 

Bedicated/devoted/honest/loyal/conscientious 

tells the truth 

accepts responsibility for own actions 
faithful to obligations and commitments 
stays on task 

stands up for what is believed to be right 
provides an accurate account of how time is spent on the job 
does not steal from the company— even small things such as pencils, pads of 

paper, pern, etc. 

admits errors 
does own work 
works a full day 

doesn't speak negatively about company 
maintains confidentiality 

Dependable/puDCtual/reliable/responsible 

accepts responsibility for own actions 
is at work on time and doesn't leave early 
is at work every day 

takes responsibility for those things in one's power and control 

performs own share of the work 

uses time and supplies appropriately 

notifies supervisor if going to be late or absent 

is seldom absent 

completes required work on time 

carries through on promises 

is punctual in getting back to work after breaks 

is ready to begin work on time 

maintains confidentiality 

manages own time and activities 

Efficient/quality of work/achleving/speedy 

organizes work assignments 

produces goods or services to within required quality specifications 

completes required work on time 

is prepared with all materials necessary 

can immediately locate necessary materials 

plans ahead to avoid delays and wasting time 

is aware of what work is due when 

uses a minimum amount of time to do a task well 

makes efficient use of time and materials 

Eojotionally stable/judging/poised 

sees the consequences of own actions 

makes decisions v/hen there is no right answer 

suppresses annoyance with misfortune, delay, and other job frustrations 
is aware of and able to accept own strengths and weaknesses 
tolerates ambiguity 



values own accomplishments 

accepts correction and criticism without blaming others, offering excuses, or 
becoming angry 
learns from criticism 
learns from mistakes 
can analyze problems 

identifies and chooses among vternative solutions to problems 

does not permit personal life to interfere with performance of job duties 

deals with pressures in completing tasks 

knows when own work is being done well 

can appropriately assert own rights 

can discipline self to do undesirable parts of the job 

Independent/initiating 

organizes work assignments 

can make decisions when there is no right answer 

finCiS solutions to problems 

can dftvise and execute a plan of action 

works without supervision, if necessary 

deals with unexpected things that happen 

manages own time and activities 

figures out a better way to get things done 

Neat/orderly/personal appearance/manner 

is clean (clothes, body, hair, skin, teeth) 

wears pressed clothes 

practices good health habits 

dresses appropriately for the job 

behaves in a manner appropriate to the workplace 

Persevering/patient/enduring/tole. act 

continues on a task despite difficulty or obstacles 

displays a fair and objective attitude toward practices different from own 

respects the point of view of others 

follows through on tasks 

is patient when encountering difficulties 

accepts differences in the way of performing tasks 

is tolerant of individual differences (race, ethnicity, sex, handicap) 

Pleasant/friendly/cheerful 

responds positively to legitimate requests of others at work 
smiles frequently (and when appropriate) 
acknowledges others (verbally or non-verbally) 
uses a "warm*' tone of voice 

participates in employee tocial activities that occur during working hours 
accepts assignments pleasantly 
exhit'ts an interest in others 

communicates freely with co-workers and supervisors 



7 



26 




0 Responsive/follows directions 



follows the rules 

acknowledges legitimate authority 
follows instructions as given 

adheres to company policies, rules, and operating procedures 

listens carefully to all instructions 

accepts assignments pleasantly 

works within the organizational structure 



Greenan*s study to identify generalizable skills in secondary vocational programs (1983) 
examined mathematics, communications, interpersonal relations (including behaviors), and reasoning 
skills in secondary agriculture; business, marketing, and management; health; home economics; and 
industrial occupations training programs. In the great majority of programs, the following work 
behaviors, which are considered in this study to fall under interpersonal relations skills, were 
found to have high generalizability. 

0 Work effectively under different kinds of supervision 

0 Work without the need for close supervision 

0 Work cooperatively as a member of a team 

0 Get along and work effectively with people of different personalities 

0 Show up regularly and on time for activities and appointments 

0 Work effectively when time, tension, or pressure are critical factors for successful 
performance 

0 See things from another's point of view 

0 Engage appropriately in social interaction and situations 

0 Take responsibility and be accountable for the effects of one's own judgments, 
decisions, and actions 

0 Plan, carry out, and complete activities at one's own initiation 

Also under interpersonal skills, in addition to the work behaviors, are listed skills for instructional 
and supervisory conversations and skills in conversations. The skills in conversations are as 
follows: 

0 Be able to handle criticism, disagreement, or disappointment during a conversation 
0 Initiate and maintain task-focused or friendly conversations with another individual 
0 Initiate, maintain, and drav; others into task-focused or friendly group conversation 
0 Join in task-focused or friendly group conversation 

The studies of general skills are valuable for three reasons. First, they orient us to the 
concept. Second, they provide a structure for determining what the most basic positive work 
behaviors are. Third, they can be used to teach pre-vocational courses. 
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Findings from Studies on Occupationally Specific Skills. Some studies, such as that of 
Beach and Kazanas (1981) reveal that different occupations require or emphasize different 
behaviors. Therefore, to do the clearest and most thorough job of teaching positive work 
behaviors, the behaviors need to be tied to specific occupations or even to specific tasks. 

According to Pucel (1987), While we still need to teach workers the cognitive information 
and the physical manipulative skills we have traditionally taught, that is no longer sufficient. 
Positive work behaviors are now as essential as the psychomotor skills and must be incorporated 
into instructional programs . . with the same level of planning, precision, and commitment as 
they have devoted to psychomotor skills" (p. 11). 

The National Commission on Secondary Vocational Education (p. 26) clearly stated its 
positior on the importance of teaching positive work behaviors when it stated — 

In addition to developing occupational skills, secondary vocational courses must 
develop self-esteem, positive attitudes toward work, safe work habits, job-seaking 
skills, and other general employability skills. 

This cannot be done by teaching behaviors separate from the rest of the curriculum. 



Instructional Stvategies/Technioues 

Positive work behaviors can be taught in different ways and in various combinations of 
ways. No matter what technique or variety of techniques is chosen, one principle should not be 
violated: the trainee must be made aware of what behaviors are expected of him/her in various 
situations. The communication must be overt. 

Non-integrative Strategies. Teaching positive work behaviors to all students is 
appropriate. No matter what students* plans for education, the vast majority will eventually enter 
the world of work. They need to be as well prepared for that eventuality as possible. In a recent 
(Winter 1987/88) article by Baumgart, he states: 

New industry has made it very clear that ... it does want the high school to give 
them employees with at least 



If high school graduates are expected to have these abilities, it follows that postsecondary 
graduates should, also, and, perhaps, to an even greater degree. It seems that most employers 
value positive work behaviors even more than technical skills (Beach and Kazanas 1981). 

When taught in a special pre- vocational class, as part of a citizenship class, or as a special 
ethics class taught by guidance and counseling staff, positive work behaviors can be introduced 
to students. Teaching positive work behaviors in a non-integrative approach, however, is only the 
first step. Beach and Kazanas (1981) summarize the view of Kampsnider (1977) when they 
discuss a three-stage model for teaching these behaviors as being the most effective method. The 
three stages are: "(1) awareness, (2) modeling, and (3) implementation. Consequently, the initial 
step toward students* acquisition of affective work competencies (achievement) would be their 
increased awareness about which characteristics are desirable and why they are important" (Beach 
and Kazanas 1981, p. 55). But awareness is only the first step. The same is true of business and 
industry trainees. 



0 



basic communication and computation skills. 



0 



good attitudes and good attendance habits, and 



0 



a capacity to work closely with other people, (p. 18) 
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Integrative Strategies. By integrating desirable behaviors into curriculum as specific 
competencies to be achieved, associating those behaviors with specific tasks, overtly informing 
trainees of what is expected, and providing a model of the behaviors, trainees stand the best 
chance of being successful. 

Initially, this may require a great deal of preparation on the part of the instructor, 
especially if he/she must start from "scratch" by doing a job and task analysis. If the curriculum 
the instructor is using is current and performance-based, then only the positive work behaviors 
appropriate to each task must be determined. This can be done using a special committee of 
persons who are experienced in that occupation to provide input related to expected work 
behaviors. Or, when available, a task analysis or curriculum that has already been developed by 
someone else can be used. 

One of three basic approaches may be used to identify positive work behaviors so they 
may be integrated into curriculum: 

0 Ask a DACUM or other committee, as part of the job analysis, to identify positive 
work behaviors at the overall job level. 

0 As part of the task analysis, identify the behaviors in relation to each specific task. 

0 Use both of the above approaches. 

Job and task analysis. The DACUM (Developing a Curriculum) approach to curriculum 
development can be used to determine what tasks are important, and then, what skills, knowledge, 
and behaviors are required for each task that mut* be performed. A good job and task analysis 
will result in a performance-based curriculum, which is clear and straight-forward. 

How does the DACUM process work? Eight to 12 expert workers are carefully selected 
from the job or occupational area that is to be analyzed. This committee then works with a 
facilitator to identify and sequence the duties and tasks that are performed by successful workers 
on the job. In addition to the duties and tasks performed, . , lists of tools, equipment, supplies, 
and materials pertinent to the occupation; traits and attitudes important to workers in that 
occupation; and general knowledge and skill areas that are prerequisites to job performance" are 
also identified (Norton 1987, p. 15). For the job of graphic designer, for instance, a DACUM job 
analysis produced the following list of traits and attitudes: 



0 


Resourceful 


0 


Dedicated 


0 


Cooperative 


0 


Patient 


0 


Persuasive 


0 


Neat 


0 


Understanding 


0 


Proud of Work 


0 


Flexible 


0 


Conscientious 


0 


Dependable 


0 


Precise 


0 


Curious 


0 


Creative 


0 


Good memory 


0 


Imaginative 


0 


Analytical 


0 


Adaptable 
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• Pucel (1987), also advocates conductiiiB a job analysis to determine behaviors appropriate 
to a job. 

Just as we identify job-related psychomotor behaviors by conducting a job 
analysis to determine what behaviors [skills] a qualified person in an occupation 
needs to be able to perform, it is also possible to identify job-related affective 
[positive work] behaviors that are required in order for a person to succeed in 
an occupation throug'^ i job analysis. The resulting job-related affective 
behaviors are the legi. .ate content to be taught by vocational educators and 
industrial trainers as they prepare people for careers and occupations. They 
warrant the same quality of instructional planning and delivery as are afforded 
psychomotor behaviors [skills]. The test of whether an affective behavior is 
job-related is if its absence inhibits a person from being employed in the job or 
from maintaining employment in the job. If an affective behavior can pass this 
test and is verified by a qualified advisory committee, it should be treated as 
legitimate content for the instructional program along with the psychomotor tasks 
which have also been verified, (pp. 13-14) 

Once the tasks have been identified, whether through DACUM or another procedure, the 
tasks should be verified. This is generally done by requesting workers who perform the tasks or 
the immediate supervisors of such workers to review the tasks and rate them as to their 
importance. One way to accomplish this is to mail a task inventory to these two groups and 
request their response. The tasks that are verified as important are then organized into a DACUM 
chart or verified task list. 

Exhibit 1 shows an example of a form that can be used for task analysis and a sample 
analysis that has been developed for the task: prepare a business letter. When using a task 
analysis form such as this, each step of the task being analyzed should be carefully considered to 
determine what, if any, behavior is important as the worker performs that step. It should be 
noted that there will not always be an important behavior associated with each step. 

Summary 

Positive work behaviors can be taught as separate units or integrated into many units. 
These approaches, although having value, do not allow the trainc-es to observe modeling or to 
implement (perform) behaviors as they relate to occupations. The use of simulations, on-the-job 
training, and role modeling, for example, provide excellent opportunities for trainees to perform 
behaviors they have been made aware of and seen modeled. 

Awareness, modeling, and implementation, then, are the three steps in acquiring a 
behavior. To encompass all three steps, an integrated, performance-based curriculum should be 
developed for each curriculum area being taught. Performance-based training can and should 
provide trainees the opportunity to move through all three steps to acquire the appropriate positive 
work behaviors. 
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Exiutr 1 



MUX 



P«PA>E ytlTTEIt OOCWgilTS 



St«p« 



(io«l Uttl) 



NauriaU 



Safety 



Scicfica 



lUthcaatfct 



Lanouagt 



Attltudtt 



1* Dacfd« on lattQr 
forMt 



2. Satact MtarUta 



Chsck draft for 
spall fns* 
punctuation, and 
adftfng 



4* Edft lattar aa 
naadad 



5* Typa lattar 

6. Proofraad lattar 



7* Ntka corractfont 
or ratypa 

6* Naka final chack 



9. Sufaaft to urftar 



bualnacs lattar 
forut t<ftad 



approprlata 
lattarhead 

approprftta 
typa atyla 

error fraa 



arror fraa 



arror fraa 
naat 



wfthfn raaaonabla 
tfaa 



atatfonary 
typi^aads 



avoid papar 
cuta 



panel I /pen 



typaurltar or 
word procasaor 



typaurltar or 
word procaaaor 



undarat^nd 
bualncaa 
lattar forMt 

typa atylaa 



•dltlng akllle« 
OraMar, apall 

ins, end 
punctuation 



editing akllla, 
oraaur, 
apalllng, and 
punctuation 



grawar, 
apall Ing, and 
pimctuatlon 



proofreading 
akllla 



follo«a Inatruc* 
tlona aa given 



can Mke decl- 
alont when there 
la no right or 
wrong anawar 



producea gooda 
or aervlcea to 
within required 
quality apaclfl- 
catlcna 

revlewt work to 
check for Ita 
accuracy 

produce gooda 
or aervlcea to 
within required 
quality apaclfl* 
cetlona 



fcnowa when own 
work la being 
dona wall 



la particular 
about the fin* 
lahad product 

review* work to 
check for Ita 
accuracy 

uaea e alnlMM 
caount of tlaa 
to do a Job wall 

la aware of what 
work la due whan 
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Introduction 

1. A technician was assigned to test instrument channel A, but mista- 
kenly connected the test equipment to channel B, resulting in a reactor 
scram. 

2. A reactor operator mispositioned control rods during a reactor startup. 

3. A reactor scram occurred during the performance of a reactor level 
detector calibration due to pressure perturbations caused by isolating 
the detector. 

4. Two maintenance workers received significantly high dose rates when 
the control room failed to notify Health Physics of a resin transfer. 

Although these situations appear to be a rather diverse collection to events, they share 
many common threads. In all cases, the identified cause was inattention to detail The 
corrective actions for each situation were identical — "the individuals involved were coun- 
seled and training was conducted." Finally, in all cases there was a repeat event within 6 
months! 

The real common thread between these four events was that they were all improperly 
analyzed and canned solutions were used to address plant problems. The recurrence of 
each event clearly demonstrates the inadequacy of the event analysis performed and the 
corrective actions adopted. 

Purpose of Root Cause Analysis 

Equipment failures and plant trips costing millions of dollars can be avoided when the root 
causes of plant events are determined. The primary purpose of a root cause analysis, or 
event investigation, is to prevent similar occurrences and thus improve operational safety. 
Properly applied analytical techniques will help appropriately focus corrective actions tO 
these problems and avoid the shallow approach of treating the symptoms. Recurrence of 
an event can only be prevented when all the root causes have been determined. 

Root cause is defined as: "the most basic cause(s) of an event that, when 
eliminated or compensated for, will prevent recurrence." 

Root causes are those that we have the ability to take some action to 
prevent. Prevention may be from a management, engineering, or opera- 
tional perspective. 

The intent of a root cause analysis is not to place blame but to determine how to clarify 
responsibilities and reduce errors. Collateral purposes of an investigation are to determine 
the nature and extent of the event and its overall impact; to assist in the improvement of 
policies, standards, and regulations; and to improve plant performance and reliability. 
These purposes and benefits are summarized on the following page. 



Clarify 
responsibilities 



Determine 
overall Impact 



Additional Benefits 

- Demonstrate mgmt 
commitment 

- Dispel mysteries 

- Improve supervision 

- Satisfy public's 
"right to know" 



Improve 
policies ) 
standards > and 
regulations 



Reduce 
Errors 



Improve 
Reliability 



Purposes of Root Cause Analysis 



Root Cause Analysis Programs 

There are several programs being used by industry to aid them in performing root cause 
analysis. Four such programs are the Management Oversight and Risk Tree, Human 
Performance Evaluation System, Kepner-Tregoe Problem Solving and Decision Making, 
and the Savannah iliver Cause Coding Tree programs. 

Management Oversight and Risk Tree 

Management Oversight and Risk Tree IMORT) was developed by the National Safety 
Council for the Energy Research and Development Administration (now the DOE). It is a 
combination of the best safety practices and "system safety" concepts from the military 
and aerospace industry. This systemic approach to the management of risks incorporates 
ways to increase reliability, assess risks, control losses, and allocate resources effectively. 

The acronym MORT carries two primary meanings to most people: (1) the MORT tree, 
which organizes risk, loss, and safety program elements and is used as a master worksheet 
for event investigations and program evaluations; and (2) the total safety program. The 
MORT process includes four main analytical tools. These are: Change Analysis, Energy 
Trace and Barrier Analysis, MORT Tree Analysis, and Positive (Success) Tree Design. 

MORT is now used internationally by many organizations, including DOB contractors, the 
Nuclear Regulatory Commission, the aviation industry, chemical plants, and utilities. 
MORT is used in all major DOE accident/event investigations. 
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Human Performance Evaluation System (HPES) 



The Institute of Nuclear Power Operations (INFO), working with several member and 
participant utilities in an extended pilot program, developed a non-punitive program de- 
signed to identify, evaluate, and correct situations that involve human performance errors, 
HPES has been revised and improved based on the operational experience of participating 
utilities. Today many domestic and international utilities are participating in the program. 

The objective of the Human Performance Evaluation System is to improve plant opera- 
tions by reducing human error through correction of the conditions that caused the error. 



The program is founded on the following premises: 

Human error can be reduced and mlnfmlzed. 

By studying an event, the basic cau<;es of human error can be deter- 
mined. This information is used to modify training, procedures, or 
hardware to prevent recurrence of the error. 



The causes of minor events are often the same as those of major events. 

The careful study of a minor event can often correct a problem that 
could have caused a major event. 



The management environment is of key importance. 

People want to perform well and will try harder if they feel that 
management is helping them improve their performance. Punitive 
action usually does not correct underlying event causes and It discour- 
ages workers from reporting mistakes. 



Accurate identification of causes can preclude repeat events. 

When the causes of an event are accurately identified and effective 
corrective actions are placed in effect, the chances for similar occur- 
rences will be greatly diminished. 



Lessons learned from human error events must be shared. 

Sharinn: lessons learned throughout the industry promotes better plant 
and industry-wide understanding and correction of human error causes. 

A summary of the HPES program is illustrated on the following page. 
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Human Performance Evaluation System 
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Kepner*Trogoe Problem Solving and DcclBlon Making 

The Kepner*Tregoe program is widely used by business and industry to improve individual, 
group, and organizational effectiveness. Many utilities offer Kepner-Tregoe training to 
their supervisors and managers. The KT program includes four systematic approaches to 
strategic operational decision making: 

Sitnarion Appraisal is a technique used as a starting point for approaching 
problems. 

Decision Analysis helps managers shift focus from alternatives to objec^ 
tives, encouraging careful definition of the decision to be made before draw» 
ing conclusions. 

Potenrial Problem Analysis is used to identify possible actions to prevent 
problems from interfering with the successful implementation of a plan. 

Problem Analysis is an efficient way to find the true cause of a problem 
before committing to a solution. 

Each process fulfills a clearly identified purpose. The choice of which to use will depend on 
the question at hand. Therefore, each takes a different approach to solving concerns. 

Savannah River Plant Cause Coding Tree 

This system was designed to help identify root causes of plant events. The use a cause 
coding tree allows the data to be used for tracking and trending. This program was 
developed in 1985 by the Reactor Safety Evaluation Division in response to the need for a 
"nuclear specific'' root cause analysis program. 

Elements from several existing programs were studied & used including INPO's HPES 
program, INPO's Significant Event Report identification system, MORT, current methods 
already in use at SRP, and specific analytical techniques. 

The premise of the program is that 80% of events in complex systems are caused by 
problems over which operators have no control, but management can fix. The other 20% 
are human failures, some of which can be corrected and others that cannot. The SRP 
Cause Coding Tree targets causes that fall into the 80% category. 

The coding starts with the event or causal factor at the top of the coding tree. The 
analysis proceeds down as far as possible toward the root causes. If information is in- 
sufficient to reach the root causes, the analysis stops at the lowest level of the tree that 
was reached. 

A strong selling point for the SRP approa<:h is its simplicity. Only five top level categorie.<j 
are used to describe the problem. After ohe problem has been isolated to a responsible 
department, seven basic root cause categories are used to further categorize the problem. 



Steps In a Root Cause Analysis 

A root cause analysis can be broken down into five major steps, as seen below. 



Define the Scope 

Select personnel 
Identify resources 
State the problem 



Gather Information 

Examine the scene 

Review operational re'^ords 

Interview those involved 



Analyze the Data 

Apply analytical methods 
Determine probable causes 
Isolate root causes 



Document Results 

Executive ^;ummary 
Details of the event 
Judgment of needs 



Recommend Corrective 
Actions 

Based on judgment of needs 
Prevent event recurren':e 



Steps in a Root Cause Analysis 
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Defining the Scope 



Tlie first step in any root cause analysis involves defining the scope of the investigation 
and selecting the personnel who will perform the analysis. Consideration must be also be 
given to resources needea, authority of the investigating team, and time constraints that 
must be adhered to. 



Gathering Information 

The accuracy of data gathered in an investigation largely depends on the time period 
between the event and the initial investigation. It is important to physically examine the 
scene of the event as soon as possible, then supplement this evidence with interviews and 
research. 



Analyzing the Data 

In this step the analytical methods are applied to the problem to determine probable 
causes. Each probable cause is analyzed for its causal or contributing relationship to the 
event. These root causes and contributing factors, identified in the analysis, will be used to 
determine corrective actions to be taken to prevent recurrence. Some techniques applied 
are: 

• Change Analysis 

• Event and Causal Factors Charting 

• Hazard'Barrier-Target 

• Fault Tree Analysis 

• Problem Analysis 

• Task Analysis 

• Technique of Operations Review 

• Surveys and Questionnaires 



Doeumenting Results 

The purpose of the investigation report is to convey in clear and concise language the 
results of the investigation, including the facts surrounding the occurrence, the analysis of 
these facts, and the conclusions drawn. The report constitutes a record of the occurrence 
and measures the thoroughness, accuracy, and objectivity of the investigation. In addition, 
any corrective actions directed by plant management will be based largely on the contents 
of the report. 



Recommending Corrective Actions 

The final step in a root cai e analysis is to ensure the event does not happen again. This 
can only be assured if focused, corrective actions are enacted to remedy the problems 
found in the people-plant-procedure relationships. 



Who should be trained? 



Root Cause Analysis becomes a way of thinking ~ it pervades your thoughts and teaches 
you a new way to look at situations. It is difficult to instill this heightened awareness in all 
plant personnel, but the more training we provide, the better ou - plants will run. An 
excellent vehicle for our task is the continuing training programs for the various work 
groups. Include some amount of RCA training in these continuing training sessions. Walk 
through case studies of operating experiences. Demonstrata how problems can be solved 
without blaming anyone. I strongly endorse some RCA training for all operating person- 
nel. The level of training and the emphasis will change from group to group, but strong 
opportunities to improve plant operations exist with all groups. 



Maintenance - These workers are frequently the first to discover a problem. They perform 
the calibrations, repair, and troubleshooting of our most complex plant systems. They 
must be made aware of the importance of preserving evidence and failed pares. They must 
understand the importance of properly documenting both routine maintenance as well as 
troubleshooting and repair activities. Valuable data should be retained for future use. 



Planners - Often these individuals are responsible for allowing repeat failures to go unno- 
ticed and merely "write up another work package." In plants without extensive tracking 
mechanisms in place, the planner's memory is the tracking mechanism. Sadly, at many 
plants planners get little if any training. 



Engineering - These professionals are the individuals responsible for the performance of 
our complex systems. Many responsible engineers lack basic troubleshooting skills and 
raly heavily on experienced technicians to lead the way. They would like to learn the 
techniques necessary to allow them to troubleshoot their systems. They also need to be 
able to recognize mechanisms and modes of equipment failure. Teaching them the details 
of fractography may not be the answer, but explaining what resources are available inside 
and out-'*de the company to help them study failed parts would be very valuable. 



OperaHons ■ These people run our power plant systems, participate in incident response 
teams and prepare event reports. They certainly need training to identify the root causes 
of problems and prevent their recurrence. 



In summary... 

We need to change attitudes if we are going to improve reliability and reduce errors. The 
benefits of reducing scrams and errors are too great to be ignored. The cornerstone of a 
strong root causs nalysis program is the commitment to solving problems, not affixing 
blame. That message must be loud and clear to all, from the president down to the troops. 
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Using Computer Technology to Enhance Instruction 

Ronald C. Comer, Ph.D. 
Ohio State University 
College of Medicine 
Columbus, Ohio 
(614) 292-6192 

Computer controlled interactive video is usRd by Ohio State 
University College of Medicine students to study and learn topics 
in ophthalmology, cardiology, parasitology, and anatomy. The 
College has produced two videodiscs containing faculty collections 
of video and audio materials. Computer-based education programs 
have been locally developed to interface with these and other 
generic videodisc materials. other discs and program mrterials 
have been obtained from the National Library of Medicine, 

The use of advanced technology for instruction has become 
increasingly effective over the past ten years. Computer-Assisted 
Instruction has offered great potential since the late 1960 's. For 
many years, however, successful projects were not plentiful. 
Offsetting the advantages of computer-assisted instruction were 
major disadvantages that included a large investment in hardware, 
lengthy time-lines for development, and lack of available 
computer-assisted instruction programs that could be acquired on 
the open market. Where projects were successful, centralized 
organizations were established providing experts in instructional 
design and programming to work closely with faculty in the 
development, implementation, and maintenance of the comouter-based 
materials. 

With the advent of the microcomputer, the role of computer-based 
education began to change rather significantly. Inexpensive 
computing was immediately available to both faculty and students; 
so the problem of access, at least in foraml education settings, 
was largely resolved. Interest increased rapidly during the early 
80 's as the use of graphics and color increased motivation as well 
as effectiveness of teaching materials. 

The education and training communitv became even more enthusiastic 
about the use of advanced technology for dirc»ct instruction when 
interactive videodisc was introduced. With immediate access of up 
to 54,000 still frames of visual materials, 30 minutes of 
full-color video, and two sound tracks of audio all functioning 
under computer control, the use of interactive video has brought 
a new sense of realism and drama into the instructional 
environment. 

At the Ohio State University College of Medicine, program 
participants are enthusiastic about the future of interactive video 
technology for instruction. The systems are well r&cfeived by 
medical students who use the materials on a voluntary basis and by 
faculty who are involved in the production of the programs. 



The instructional strategies used in the design of the College's 
learning materials are equally effective in other education and 
training environments. Benefits are particularly significant when 
providing instruction to employees or students who are dispersed 
geograpnically. in business, industry, government, and the 
military, technology-based education offers cost effective 
solutions to educational problems. 
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Using Evaluation Feedback 
For Instructional Improvement 



Michael Price 

Lead Certification Examiner 

Project Manager Irnovative Technologies 

GE BWR Operations Training 



Training's target is improved 30b performance of the individual. 

The first step is defining desired job performance. This 
definition, referred to as the objective, is used to generate 
evaluations. Evaluations will determine the gap between what 
30b performance should be and what it is. 

Only with objectives and evaluation can we begin to design 
training programs to meet the specific needs of each student. 

Evaluation becomes the key word here. Following the TSD model 
for training we improve our programs as feedback is received. 

The evaluation and feedback phases of TSD are what make TSD a 
dynamic rather than a static model. Using the TSD model has 
allowed for ongoing program improvements. 

The continual improvement of programs and emphasis on program 
achievement has been acceptable only because there were no cost 
effective alternatives. Tracking individual students and 
generating training to meet their individual deficiencies could 
not -be done economically. 

Using the TSD model, we have improved programs bacod on overall 
measurements,. Our next step is to tap into a model for training 
to meet individual needs. 

In the 70 's and 80 's we had the option of only dealing with 
students that fit the program. There were plenty of students 
with the skills and background for the technical positions. 
This is no longer true. By 1992 new skilled positions will out 
pace new entries into the skilled workforce. We can no longer 
afford to only look at program improvements. 

Using an expanded training model that provides feedback at every 
phase allows us to train to the individual's needs. This offers 
a far more efficient and effective training program. Why train 
them in what they don't need? 

The question becomes "How can we be cost effective and look at 
each individual in hundreds of proficiencies? 

General education tried this and, although providing 
individualized instruction works well, the time and talents of 
those doing the tracking were stretched. 

We now have the missing pieces. The mechanisms exist to match 
our training to the individual's needs without jeopardizing the 
integrity of the overall program objectives. 



Using the computer to track, report, and prescribe training for 
the individual is both efficient and effective. 

Looking at feedback as a useful tool throughout the model allows 
us to look beyond the past formal use of feedback and forward to 
its use as an ins^ ^ment to continually adjust training to the 
individual. wit. cracking and adjustment in place the 
feedback becomes tne compass for the training path. * 
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IMPROVING THE QUALITY OF INSTRUCTION 
THE FIRST STEP TOWARD EXELLENCE 



Introduction 



As instructors / trainers in the nuclear indsutry, each of us 
over the past ten years have been asked to 'rethink' what our roles in 
developing and delivering instruction in our industry should be. In 
some cases, we have said ../It's about time we did this!", but at other 
times its been ..."Why are we doing this? Training as we all know, 
has been in the spotlight ever since the accident at Three Mile Island 
occured in March of 1979. Today, even after ten years of 
concentrated efforts to improve training techniques in the nuclear 
industry, the focus is still on the importance of training personnel for 
safe plant operations. Dr. Forrest Remick, the soon to be appointed 
NRG commissioner, stated at INPO's 1989 Training Managers' 
Workshop, that several challenges still remain in the training of 
nuclear plant personnel if excellence is to be achieved. 

During Dr, Remick's talk, one of the areas he focused upon was 
the knowledge and skills of the instructor. Not the instructor's 
technic>":il knowledge and skills, but the teaching abilities of the 
instructor were his concern. He stated "...very few instructor delivery 
weaknesses were identified by the (evaluation) teams during initial 
accreditation. It is my understanding that increased emphasis is 
being placed in this area during accreditation renewal visits." He 
supi)orted his concern in this area by sharing the comments he has 
received. These included: 

"Interviews with operators indicated that 
the quality of training was poor." 

"The quality of the classroom material 
leaves much to be desired. It remains 
vintage 1950 and is superficial in coverage." 

"A reactor operator said, 'reactor theory 
isn't important because we don't see it in 
the control room. It is certainly obvious why 
the operators don't see it in the control 
room, it isn't in the classroom to begin 
with'." 

For Dr. Remick, this raised the question of whether adequate 
evaluation of instructor skills and knowledge is occuring. This is an 
interesting question. What is the "Quality" of OUR Instruction? 
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WHAT IS QUALITY? 



Often when we look around ns, we find many different 
definations of quality. For example, in one of AT&T's television 
conmiercials they state that the important aspect of the telephone is 
its dependability. Where as one of their competitors, Sprint, believes 
that the clarity of transmission is the most important aspect of 
telephone service. Each is betting that their interpretation of what 
the customer wants is correct. We see these de/initions almost 
everyv^here, adyertisments for cars, boats, lawn mowers, 
hamburgers, services, paper, etc.; the list goes on and on. If you put 
all these definitions together, you find that quality is being defineci as 



Meeting or exceeding customer eXj^ectations, 
What the customer says it is. 
Dependability, 

Products backed by a guarantee. 
The very best products or services. 
Products or services that leave a special 
impression. 

Products with many standard features, and 
Committed dealer service. 

As you can see, this is a fairly diverse list, and it wotJd be 
difficult to sum up into a simple statement. Even the experts can't 
agree on the definition of quality. Phillip Crosby. '\ renown quality 
consultant has defined quality as: "Conformance to requirements, 
where the standard is zero defects." In other v/ords, companies must 
set performance standards for products or services and then adhere 
to tnose standards with no exceptions. This was probably bes**. 
expressed by Sydney Harris, colmninist for the Detroit Pi^ee Press in 
an article entitled "We must hope for the best in order to come close 
to it". Basically he said that we must always look for the hdghesl 
quality. Once we settle for less, then our standard gets lower and 
lower until .ally we will be measuring quality as we do quantity, by 
the smallest tmit that is convenient, rather than by the largest. If 
this occurs, we find ourselves choosing between the lesser of two evils 
rather than choosing the best for the situation. Mr. Harris summed 
it up this way; "...The archer always aims at the center of the target, 
though he knows he may not hit it. To aim elsewhere is literally to 
lower one's sights/ It may be idealistic to hope for the bulFs-eye, but 
it is the most realistic way to get close to it." Thus we must set high 
standands, and then continously aim for the "bull's-eye." 

Another renown quality expert, John Guaspari, who has 
written several books on quailty, said, "Quality? I know it when I see 
it." Here he is saying tnat our customers know what quality is, 
therefore, to produce quality products or services you must talk to 
them and find out what they want. 
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Can it then be said that "quality is in the eye of the beholder?" 
But, who is OUR beholder (customer)? Is it the NRG; INFO: Plant 
Management; Training Management; our Students; the PubUc; or 
all of the above. For many of us, this is our first major hurdle we 
need to cross; we must decide v/ho our true customers are. 

Unfortunately where quality is concerned, you hear the 
statement that something is a "...quality product or service." There 
are no nice units for quality, is there? For example, this course or 
lesson plan has 10 widgets of quality. All we can do is compare the 
quality of products or ;es; e.g. this product has a higher quality 
than that product. But with what do we compare our instruction? 
We compare it to o\xr customer's expectations or needs. If it meets 
the'r expectations, it has good quality* If it ej^'^'eeds their 
expectations, it has high quality. This is why I would like to thii^i of 
cuality as "...performance againsv expections." But these 
expectations are not just any expectations, they exe the Idghest 
expectations. To have a high quality product, we must compare it 
against the best, not the worst. 



ACHIEVING QUALITY 



How do we achieve quality? This is the crux r? the issue. 
Another writer who has addressed quality, Wiila Foster, said, 
"Quality also marks the search for an ideal after necessity is satified 
and mere usefulness achieved." She also stated, "Quality is never an 
accident. It is the re* ^ of: 

• High Intentions, 

• Sincere Effort, 

• Intelligent Direction, and 

• Skillful Execution. 

Quality represents the ynse choices from many alternatives as well 
as the comulative experience of many masters of craftsmanship." 

A siiapler way of saying the same thing is that "...you achieve 
(Ktality by doing the right things right the first time." The "right 
tiiingf?" are the attributes of the product or service that meet gnd 
exceed your customer's expectations, the things that define the 
"target." Doing it "right the first time" is related to the quality in the 
workplace. It has to do with "personal attitude and job 
environment." The attitude is to du the best possible job that can be 
done. The environment is one where the organization and the people 
support each other by providing the tools, the time, and the trust 
necessary to complete the jrbs correctly. In other words... Aimin g for 
the Bull 's eve. 

But who's expectations are we to focus on? 



1148I/Rev.l 



3 of 6 



HAVING A Q UAILTY ATTTTTTDTC 



As Instructors / Trainers, each of us should share a common 
responsibility that can be expressed simply as: teach our students. 
Our product in this case is an "educated individual/' But isn't our 
product at times, also our customer? 

If our attitude is not the best, or if we don't care about our 
product, does that mean then we don't care about our customers? 
Our product, whether it be a system description, an instructor lesson 
plan, a test, or a presentation, will reflect our attitude toward 
quality. If our attitude is poor, then our product will be poor. 

But how do you improve one's attitude tc ward quality? 

Having ownership in the product is probably the most direct 
link to developing a quality attitude. When you "own" a j)roject or 
product, your work with that product will reflect your ideals, and 
your committment because you feel that you are contributing to the 
success of the product, and it, in txim, is a reflection on you and your 
capabilities. Everyone wants to do a good job. 

However, to gain ownership of a product or project, f:e 
environment must be conducive for individual contributions. People 
need to feel that they are a valuable asset, that their work is 
important for the safe operation of the plant, and ulitmately for the 
protection of the public health and welfare. 

Next, we must xmJarstand the goals and objective of the 
organization and how we as individuals, fit into the plan that will be 
used to accomplish these goals. Once this has been established, then 
an open, honest atmosphere for communications of individual 
concerns must exist. When people feel that their inputs are being 
heard by someone who can do something about it, and they see some 
kind of proactive response, they are encouraged and more willing to 
listen, as well as feedback, to their customers and supervisors. aB of 
this is well and g^ood for establishing the proper environment for 
"quality of instruction," but it is still up to the individual to take that 
first step. 

In our industry today, it is ea^ to sit back and be "perscribed 
to." We are told how to develop our materials, what format to use, 
how to vmte and administer our exams, even what to teach and at 
what level. But even v^dth the best training program ever developed, 
it is still the instructor that is needed to make it a high quality 
presentation. The demeanor of the instructor is as important to the 
quality of the lesson as is the lesson content and materials. In fact, 
in the past it was probably more important because the material 
quality was not as high then as it is today. The instructor therefore, 
has the pivotal role in quality instruction. 



1148I/Rev.l 



4 of 6 



C ONCLUSION 



So, what is the first step in improving the quality of 
instruction? Maybe it is each instructor accepting their role as 
educators and realizing the impact they can have in the lives of their 
students (successes and failures), and on the safety of the general 
public at large. This role is more than just regurgitating mere facts 
and figures. It means taking an active part in each student's 
education. Being a coach, counselor, helper, cheerleader, soimding 
board are just a few of the parts the interactive instructor undertakes. 

Then once this is r^aHzed, becoming proactive in their 
profession by learning how to perform their job in a manner that 
exceeds the highest expectations of all of their customers (including 
the students). Knowing the lesson content, how it is applied in the 
plant, knowing how to present it to the students so that each one 
learns with xmderstanding," and doing all of this in a manner that 
conveys a positive demeanor that is indicative of high quality, is the 
challenge of the instructor in the nuclear indusrty today. 
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PREFACE 



My colleague and friend John Magennis, who helped me prepare 
this presentation, \/as the lead subject matter expect on our 
Simulator Instructor Training (SIT) development project. I 
served as the project analyst and curriculum development 
specialist. When we implemented our first seminar back in 1987, 
he kicked it off with a few words that reflected back on his own 
development as a Simula bor instructor — which didn't benefit from 
a structured simulator instructor training program. 

He said that when he first qualified as a simulator 
instructor at Combustion Engineering (CE) and started to conduct 
simulator training^, he first focused on mastering the machine — 
the simulator tacility — how it worked, so that customers would 
not lose training time due to any facility operator mistakes. 
Once .Its operation was mastered, then he focused on observing ar 
instructing the operators who came to the CE facility to train in 
a simulated environment — to practice the technical manipulation 
of equipment — to exercise the contr'^l manipulations and use their 
plai.w procedures. Then when he was challenged to develop 
operators diagnostic and team skills, he entered a whole new 
pnase in his development as a simulator instructor — how to 
develop operators critical thinking skills. Pasc observations of 
operator error that cculd not be explained technically, could be 
explained using the principles of human information processing. 
This revelation caused him to critically analyze how his 
performance as a simulator instructor impacted the operators 
thinking during simulator scenarios — and what are the critical 
skills of an effective simulator instructor. 

His experience was buxlt into and shared throughout our 
simulator instructor training program, one that I hope you find 
interesting and challenging after reviewing this presentation and 
experiercin^ the MNTA workshop for which it was prepared. 



Jo Palchinsky 
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WORKSHOP OUTLXKE 
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CLOSING: 



Welcome 

SME Perspective 

Needs Analyais/SIT charter 

Activity #1 «^ Building u scenario 

- Equipment used 

- Instruments used 

- Procedures used 

- Related Industry Events 

Activity #2 - Uncovering the SQIOC skills 

- What would you observe? 

- What questions would you ask? 

- How would you coach? 

- How would you intervene? 

- Individual and Team Skills? 
Exercise Guide instructor cues 

- Five types of cues 

~ Excerpt of Jlxercise Guide 
summarizing the SQIOC Model 

- Target Population Frame of Reference 

- Observation Skills 
~ Questioning Skills 
~ Coaching Skills 

~ Intervention Skills 
Using v^e SQIOC Model 
" SQIOC: Adaptation Over Time 
Activity #3 - Applying SQIOC 

- Initial License candidates 

- Requal Training 

Activity #4 - Tlelating cues to SQIOC 
Activity #5 - Relating cues to Exercise Types 
~ Types of Simulator Exercises 
Job/Task Analysis 

- Methodology 

- Creating the SQIOC Model 

- Task Hierarchy 

Pilot testing the ideas 

- Simulator Instructor Skills Matrix 

- "Perform SQIOC" Task Analysis 
Program Design/Development 

- Program Map (Certification Requirements) 

- Program Outline 
Implementation/Lessons Learned 

- Simulator Practice 

- Feedback Tools 

- Simulator Instructor Development 
" SRO Supervisory Skills 

" Intercompany Transfer of Knowledge 
Questions & Answers 
Learning Points 
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CERTIFYIH6 SIMUIiATOR INSTRUCTORS 
Simulator Instructor Trainincr Proqrgim Develoisment 



Needs Analysis 

Florida Power and Light Company (FPL) working with CAE, a 
Canadian Cv^mpany, developed two high-fidelity plant-referenced 
control room simulators for use in training at the St. Lucie and 
Turkey Point nuclear plant??- The simulators, because of their 
consoles, displays, and computer systems, can simulate many of 
the conditions an operator may encounter in the actual plant 
control room. Therefore, we consider simulator training to be 
vital to the safe, efficient operation of FPL's nuclear power 
plants. 

However, we recognize that the most effective simulators can 
only contribute partially to the total training experience. The 
position of "simulator instructor'' is responsible for shaping 
this experience to achieve the total training expected in the 
nuclear power industry. 

We made two assumptions. Fir*^t, that training individuals 
and teams in a control room simuI=\tor environment is different 
than training in a classroom environment. Thus, specialized 
instructional skills are needed by technical instructors who must 
train in a simulator environment. 

Second, since simulators play a prominent role in operator 
training, the quality of operator training has b*"come directly 
proportional to the preparation of simulator instructors. 
Consequently, it waj. essential that we define the job of the 
simulator instructor position and train and certify our simulator 
instructors . 

Mark Shepherd, the Operations Training Supervisor at St^ 
Lucie, noted that the experienced simulator instructors who were 
developing our Licensed Operate.- simulator training materials 
were incorporating simulator instructional skills into the 
materials. This observation culminated in a series of work 
sessions designed to identify these specialized skills. The list 
of specialized skills was compared to the simulator instructor 
competency inventory developed by Dr. Janice Reitmeyer as a 
result of her national study. [Janice was working at the 
Susquehanna nuclear plant at the time she conducted the study.] 
So we used her list of 80 competencies as a basis for the 
systematic development of our training. 



CERTIFYING SIMULATOR INSTRUCTORS 



Job Analysis 

However, we recognized that our simulator training hcid some 
unique features, and decided to engage in a rigorous verification 
process to ensure that our resulting profile of the simulator 
instructor job at FPL included all recmired and expected duties 
and tasks. We added, deleted, and modified the original 
inventory using a strict set of decision criteria. We compared 
the results to three additional simulator instructor task lists 
compiled by: 1) the Institute of Nuclear Power Operations, 

2) the Electric Utility Instructor Development Consortium, and 

3) the Mid-Atlantic Nuclear Training Group. 

We drafted, piloted and administered a job survey to our FPL 
population that consisted of supervision, subject matter experts 
(SMEs) and future simulator instructors, and compared their 
ratings. The 24 survey respondents consisted of thirteen FPL and 
eleven full-time contracted employees. The respondents 
represented 51 combined years of "simulator" instructor, 
developer and supervisory experience in initial licensed, 
requalification, and Shift Technical Advisor simulator training, 
as well as for a variety of target populations including NRC 
Resident Inspectors, U3N Officers, Nuclear Utility management, 
engineers and Health Physics Technicians. Also, eight 
respondents had past experience participating in the Acceptance 
Testing of a simulator. 

Our survey data analysis, including tne very valuable write- 
in comments, indicated that the verified inventory actually 
reflected a hierarchy of Simulator Instructor competencias. 
Using the definitions of job components in NUREG 1750, we 
constructed a hierarchy of Simulator Instructor duty areas, task 
areas, task elements, and supporting skills, and identified 
additional elements, skills and knowledge. This became our 
preliminary task analysis information. 

The synergy of this process stimulated our in-depth analysis 
of how the successful Simulator Instructor performs on the 
simulator floor during the actual simulator exercise. We focused 
on the simulator instructor-student interface and constructed a 
preliminary model. The model represented the dynamic student- 
instructor interaction whereby the instructor integrates 
observation, questioning, coaching and intervention skills in 
order to facilitate student learning to higher cognitive levels 
of thinking. The "integration" of the four key elements was 
deemed critical to the success of the instructor when working to 
facilitate learning in the simulator environment. 
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We could not correlate this "integration" process with any 
single competency/task on the FPL Job Survey, nor any other 
industry task list. In order to proceed with the Job Analysis 
process, and a further in-depth analysis of this old but unnamed 
task, it was titled "Perform SQIOC" (pronounced sky-ock.) SQIOC 
stands for: 

SQIOC 

S = The Integral Sign = Integration 
Q = Questioning Skills 
I = Intervention Skills 
0 == Observation Skills 
C = Coaching Skills 



Our final Task Inventory resulted in three duty areas and 
thirteen tasks (see Attachment A,) 



Task Analysis 

We analyzed the nino tasks in duty area A — Implementing 
Training, and duty area B — Developing Training, To complete the 
task analysis, we refined and tested the SQIOC model (see 
Attachment B for final sqioc Model) . Based on the instructor 
cues being built into th^ simulator exercise guides (see 
Attachment C) , we drafte a Simulator Instructor Skills Matrix to 
reflect unacceptable, acceptable, and excellent behaviors in the 
important skill areas (see Attachment D.) To validate the model, 
we prepared materials and instruments and used them to pilot and 
further develop the forming concepts, principles, criteria and 
job aids. The evaluation was conducted on three levels. The 
pilot evaluation instruments were us^aJ to collect feedback from 
students (operator, STA, and Tech Staff trainees) of a group of 
future simulator instructors, the instructors themselves, and 
observers of the instructors" performance. At the Combustion 
Engineering simulator facility, the future instructors were 
oriented to the concepts and skill behaviors, were videotaped 
during several practice sessions, and viewed and discussed the 
videos using the feedback, self-assessment, and observation data. 
This pilot provided extensive analysis data that was recorded and 
validated by the Task Analysis Team (see Attachment E for sample 
task analysis.) 
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Progrzun Design 

We constructed a Simulator Instructor Career Path which 
consisted of four certification levels (see Attachment F.) The 
thirteen tasks were assigned to the appropriate levels and job 
functions as outlined below. 



SIMULATOR INSTRUCTOR CERTIFICATION LEVELS 





FUNCTION 


CERTIFIED TO 


TASKS 


1. 


Simulator Operator 


Operate simulator facility 




2. 


Simulator Training 
Developer 


Develop simulator training 


B«l,2,3 


3. 


Simulator Training 
Facilitator 


Facilitate simulator 
training 


5,6 
C-1,2 




Simulator Instructor 


All above 


All 
above 


4. 


Sr. Simulator 
Instructor 


Evaluate simulator 
training ef fectivene:5s 
S regulatory compliance 


3,4 



Dr. "Dan" Pond, an industrial psychology & ergonomics 
professor at the Florida Institute of Technology, joined the 
Design Team. Using the task analysis data, we pt^epared terminal 
and enabling objectives for the initial Simulator instructoi' 

-fining Program (see Attachment G.) The following briefly 
c scribes the instructional and evaluation strategies of the 
program design. 

Training Settings : 

Classroom/ Simulation, OJT 

Training Method s; 

Seminar with interactive presentations, discussions, 

exercises and a written exam 
Demonstration and practice exercises on the simulator 

using skill behavior modeling 
Self study oJT modules providing the opportunity for 

further practice and feedback prior to fcimal 

performance evaluation 

4 
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Instructional Media ; 

Print media including a pre- dnar reading packet, a 
notebook including seminar handouts, job aids, OJT 
guides, supplemental references, and a SQIOC Tips 
list, and simulator instruction procedures and 
forms, example exercise guides, and instructor 
facility operator insti.nictions 
Non-print media including wall charts, flipcharts, 
overhead transparencies, and the use of a 
whiteboard 

Interactive media - The full-scope FPL simulators and 
their associated on-the-job resources 



Matarials Development 

Based on the analysis data, we turther refined the SQIOC 
model and designed several graphic depictions to clarify the 
integration of it's components (see Attachment B.) We designed 
and described a human information processing (HIP) model, and its 
relationship to SQIOC (see Attachments H & I.) We depicted the 
problem-solving process to show the procedural and diagnostic HIP 
flow path (see Attachment J*) We refined the Simulator 
Instructor Skills Matrix and used it to develop task performance 
checklists that reflect expected standards. Supplemental reading 
references were carefu.lly selected and copyright permission or 
printed copies were obtained. 

The pre-reading text materials that described HIP and SQIOC 
were wr tten in a simple co read form, from a nuclear operations 
point of view (see Attachment K for article adapted from the pre- 
reading text>) A flow diagram was prepared to illur>trate the 
elements of preparing for an exercise and conducting a pre- 
exercise brief with students (see Attachment L.) A flow chart 
was prepared to depict one method of conducting a post-exercise 
critique covering all elements of the scenario (see Attachment 
M.) Visual aids were prepared to illustrate how the development 
of simulator training fit within the bigger context of the 
Systems Approach tv Training process, and the relationship 
between the various ^jroducts of each simulator training 
development activity (see Attachments N & 0.) Evaluation 
instruments and tests were prepared to assess student achievement 
of the objectives and provide documentation of certification. 
Lesson plans and OJT guides were developed to guide instruction 
through the components of the program. 
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A program map was prepared to illustrate how the simulator 
instructor flows through the program and completes the 
certification requirements (see Attachment P,) Prerequisite 
requirements for entry into the program include an SRO license or 
certification and licensed operator instructor qualification. 
Students first complete the pre-seminar reading. Then they 
attend a classroom seminar and simulator practice sessions* before^ 
completing a written exam. Finally, they complete the 
appropriate OJT guides and when ready, their performance is 

valuated. Upon complv.t:ion of all the requireipents , the gradt^-*te 
is a qualitied simulator instructor. 



Training Implementation 

Thirty-four FPL permanent and contracted instructors 
attG^nded the four offerings of the seminar and simulator 
sessions, and many have completed all the OJT requirements. The 
exf rienced contracted simulator instructors attested to the 
skills and techniques taught. Many indicated that, while tlx^y 
had not had naiaes for the skills and techniques they found Lo be 
critical to their effectiveness, they surefy recognized them as 
presented in FPL's simulator instructor training. 



Evaluation: Lessons Learned 

Since 1987, when we first began the development of the SIT 
program, and throughout its implementation, we have recei\:id 
invaluable feedback and have learned a lot. The following are 
five of the lessors learned. 

Simulator Practice 

Lesson Learned: The simulator practice component the 
training is critical to instructor skill devel<.>osient, and 
scenarios used during the practice sessions c*^..- not be too 
technically complex. 

When we implemented the first seminar at St. Lucie, t:.e 
simulators were not yet functional, so we could not pr^ /ide the 
students with an opportunity to practice the new skills on the 
simulator. This section of the training is critical to providing 
a link between the conceptual models and techniques discussed 
during the classroom seminar and doing the OJT activities. So, 
once the simulators were functional, ve implemented the training 
again for the first group of instructors including the seminar 
and simulator practice sessions^. This sr-^ond round at St. Lucie, 
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which also had Dr. Dan Pond present to respond to any questions 
regarding HIP, was much more successful. 

After implementing the training the second time at Turkey 
Point, we received useful feedback from the instructors on the 
simulator practice section of the training that in the future 
will help to make the practice sessions run more smoothly. For 
example, it's important that the scenarios used during the 
practice are not technically complex that they interfere with 
applying the instructor skills o If the instructors get hung up 
on the technical aspects oi the scenario, then they're not able 
to effectively question and coach during the exercise. 

Feedback Tools 

Lesson Learned: The three instruments thet werr used to 
validate the SQIOC model during the analysis phase oi the project 
would be useful to ucs-^; during the simulator practice component of 
the training. 

After implementing the training at Turkey Point, the three 
instruments were shared with one of the experienced contractor 
simulator instructors. During the simulator practice sessions, 
he SQIOC 'd and evaluated the instructor's application of the 
skills presented during the seminar. He indicated that the 
instruments would be useful tools to use during the practice 
sessions since they are designed '•-o rate the instructor's skills 
from three perspectives: those wuo ar. role playing operators, 
the instructors themselves, and the observ^ers. 

Simulator Instructor Development 

Lesson Learned: It takes a lot of practice and time to 
fully develop the skills of an ef fecti^ e simulator instructor 
(SI), so you can not expect instructors to master these skills 
before being certified. 

As with any interpersonal skill, simulator instructor- 
student interaction skills take time to master. This fact has 
been recognized by many experienced supervisors of simulator 
instructors. We found this to be true during our certification 
process. During initial training and certification, it's 
important that instructors: 1) learn what skills they're 
expected to perform, and identify the specific behaviors related 
to each skill, 2) demonstrate a satisfactory behavior in each 
skill area, and 3) make a commitment to continually practice the 
skills during simulator training over time, wiuh reinforcement 
and feedback, simulator instructors will continue to develop 
their skills to a mastery level. 

7 
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SRO Supervisory Skills 

Lesson Learned; The skills of an effective simulator 
instructoL- are also used by senior reactor operators who 
supervise control room crews, and they too can benefit from 
similar training. 

One of the simulator instructors who completed the training 
was an ex-shift supervisor. He recognized that what was 
presented applied to effective control room supe?rvision. His 
insight was further explored at St. Lucie, resulting in -:he 
development of SRO nupervisory skills training that included the 
HIP and SQIOC concepts and skills. A videotape was produced and 
used in a pilot session to give shift supervisors an opportunity 
to identify when to use the SQIOC skills before they practiced 
applying them in the simulator. Their feedback was very 
positive, and the piloted materials are being refined and 
incorporated in the SRO Training Program. 

Intercompany Transfer of Knowledge 

Lesson Learned: The SQIOC skills are also relevant to the 
success of maintenance crew supervisors and trainers who instruct 
in other than the simulator setting. 

The instructional approach used to develop FPL's simulator 
instructors and SRO supervisory skills at St. Lucie h? s not only 
proven successful but has gained the interest of others. 
Individuals from several nuclear plants, including Diablo Canyon, 
Indian Point, HcGuire, North Anna, and Seabrook, have contacted 
St. Lucie in response to a brief article that was in the Nuclear 
Professional. 

In addition, within FPL, wc recognise that the video-based 
approach used in the SRO supervisory skills training can also be 
effect5,ve in the training of other nuclear personnel. The 
training uses videotaped re-enactments of situations based on 
past License Event Reports to stimulate discussion of the 
specific supervisory skills (i.e« SQIOC) which are then applied 
during practice sessions. The approach is not only applicable to 
the Turkey Point SRO Training Program, but also to Maintenance 
Crew Supervisor training and the basic instructor skills course, 
both currently being developed for implementation at both FPL 
nuclear sites. To facilitate the evaluation of the already 
proven approach, information is being transferred to the 
applicable personr who are developing the maintenance and 
instructor training. 



ATTACHMENT A 



Job: sih;;lator instructor 



Duty Area A: IMPLEMENTING TRAINING 

Task A-1: Operate the simulator 
A-2: Prepare for exercise 
A-3: Conduct pre-exercise brief 
A-4: Perform SQIOC 
A-5: Conduct critique 
A-6: Conduct student evaluations 

^ Duty Area B: DEVELOPING TRAINING 

Task B-1: Analyze requirements 
B-2: Design exercise 
B-3: Develop exercise 

Duty Area C: PERFORMING ADMINISTRATIVE 
^ FUNCTIONS 

Task C-1: Maintain proficiency 

C-2: Perform support activities 
C-3: Inte^'act with regulators 
C-4: Evaluate programs 
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SYTHESIS 



APPLICATION 
INTERPRETATION 

COMPREHENSKDN 
TRANSLATION 



KNOWLEDGE 
MEMORY 



FREEffi 

STOP ALL ACTION 




0^ 



STOP MENTAL ACTION 



REALTIME TIME STOPS 



TEAM SKILLS AND WATCHSTANDING SKILLS 



I A.' 



er|c 



• 



v3 




Attach M£-^rr 



SIMULATOR EXERCISES 



Exercise - The implementation of an approval lesson plan on 
the simulator floor 



TYPES 


DESCRIPTION 


Laboratoiy 
cixerciSG - 


A session that addresses a specific portion of 
plarit operation In a theoretical and/or non- 
integrated context. 


Demonstration 
Exercise 


A sessiofj that transmits information on the 
knowledge and procedural techniques of plant 
operation by direct example. 


Practice 
Exercise 


A sessiOin that allows students the opportunity 
to practici'? the use of knowledge and skills under 
direct supen/ision. 


Evaluation 
Exercise 


A session that measures studant mastery of 
specified skills in accordance with objectives. 



Qbsarvatiow tCued) 

- faecocm sidetracked in periphcrAl 
duties 

- does not position self to eonitor 
operator actici» 

~ allONS operators to perforo actions 
without assrismt 

- doesn't iipleient observes required by 
LG or 

Ougstionina Techniques ffloit-cued) 

- fails to address target popuJation 

- does not follow hierarchy of 
questioning 

0 pre-cueinfl 

msses soae C.6 questions 

Coaching (Won-ctied) 

- no coaching 

" procedural coopliance nithout guidaice 

- unable to respond to student probless 



Intprventioiit (Cued) 

- aUcws ooehtor to perfora actions 
ircorrsctly 

- intervenes >Jtm unnecessary 

- can't intervene when directed by E.6» 

5trg«/aiwK)urct tevjegnt (Won-eittd) 
' 's unrealistic goals 
^ ices excessive expectations on 
operators 

- provides unrealistic settings/scenarios 



Constngtive fggcjb^A (fan- ^ nad) 

• fails to provide feedb^ 

" gives inappropriate pri* i or c>*iticisi 



Critigrags (Cued) 

floes not cover E.G. critique tooics 
- -rv'iticisa is negative, deee^ning 

' s not proMte self analysis/pss^ 

' ilysis 

* critiques on unannounced goals or 
expectations 



Pre-gftiffe Brief {Cued) 

- does not cover pre-shift brief topics 
in 

- cannot clarify/explain objectives 

- does not try to establish rapport with 
operators 

Evaltatlon tCued) 
\ aole to perfom all evaluations 
^K|uired by E.6. 

- interferes/intervenes when unnecessary 

- unable to record pertinent cowents 



SlWLflTDR IMSTHUCTDR 3<IIIS MOTRIN 



usually positions self strategicaiy 
to 235ess Most actions 
iipleeents only observes required by 
E.S and eost of H.S.N ^ 
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• directs questions at tarjet population 

- achieves linisal level or qu^ioning 
hierarchy 

• soie pre-cueing 

- asks E.6. questions onlv 

• instructs the operator prior to 
perfontance 

• teaches the concept of thir*. act, see 
and do 

• coaches on request or only >*;2n 
dirfv*ted by £•& 

' intb . .lies prior to incorrect action 

• can discuss in real tiae enviroraent 
intervenes when directed by E.B. 



' sets goals specified in E.6. overview 
and objectives 

' provides realistic control rood 
setting 

role Models flNPS/other staff as 
directed by E.6. 



provides feedback appropriate to eost 
real tise situaticm 
provider feedback as necessary during 
critiqts session 



cove?^ all I i. critiqws topics 
critiqiffis ba-ed on tS. objectives, 
goals, perfonunce indicators 
critique cofisents are generally 
positive and constructive 
alloits self analysis/peer pj>alysis 



' covers all prc-shift brief topics ir 
E«6* 

' atteapts to establish good 
rapport /cooBunicat ion 
' objectives and expectations ^re stated 



evaluates and records all observations 
required by the E.a 
■ usei objectives and perforaance 
indicators as evaluation criteria 
occasional questioris to clarify 
actions, understand inq, judgeaent 



alMays strategically positioned to 
•ssess operator actions 
iiplesents all L8 and observes 
SKY-OCK applied throughout 



effectively uses >bing questions 
fully i^jleaents 9<Y-0Ck sodel 



coaches effartively at all levels 
fully iaplesents SiYHXX aodel 




interrenw effectively at all t.^s 
SKV^ eodel applied to all 
interventicjn situations 



alloeis individual opof^ators to exi 
LS« goals/objectives tto) 
appropriate 
role lodels confidence and cocpetence 
in positions 
always reenforces codirg and 
diagnostics during stressful 
situati09» 



always mr^ praise/criticiai 
effectively 

encourages individual initiative 
criticiai is always corstructive 

establishes rapport for effective 
feedback on group/individual 
l»rfor«ance 

alitays provides ethods or techniqui 
for i^rovirq/hcning skills 
achieves closure for all questions 
encourages seJif analysis and peer 
analysis using and U.S.M« 

establishes a realistic setting for 
exercise 

relates objectives and goals to 
operators job 

proaotes intarest, enthusiasa in the 
exercise 



observer, questions, evaluates 
without interference 
Maintains proper distance and 
position for optiaal observation 
fully docuaents all observations 
related to perforaance, attitude, 
knowledge 
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SIMULATOR INSTRUCTOR TASK ANALYSIS TRACKING NO. A-4 

Florida Power & Light Company, Copyright, 1987 
SIMULATOR INSTRUCTOR TR..INING PROGRAM 
TASK ANALYSIS 

Tank Worksheet (Part I) 
TASK TITLE: Perform SQIOC 

NOTE A: SCOIC is pronounce i "sky-ock" 

NOTE B: SQIOC stands ror 

S - The "integration" sign 
Q - Questioning skills 
I - Intervention skills 
0 - Observation skills 
C - Coaching skills 

NOTE C: SQIOC is the student-instructor int^^raction 
process whereby the instructor integrates observation, question- 
ing, coaching and intervention skills in order to facilitate 
student learning to achieve higher cognitive levels of thinking. 

TRACKING NUMBER: A-4 

DOTY AREA: Implementing Simulator Training 

JOB TITLE: Simulator Instructor 

ANlUiiYST/DATE: Jo Palchinsky, 8/26/87 

ORIGINATING SME/DATE: John Magennis, 9/25/87 

VALIDATING SME/DATE: John Dedon, , 10/3/87 

SUPERVISOR REVIEW/DATE: Mark Shepherd, 9/25/87 

TERMINAL PERPOt NCE OBJECTIVE: 

TASK CONDITIONS: Given any student target population and an 
approved exercise guide, the simulator instructor will 

ACTION STATEMENT: perform SQIOC 

TASK STAND3UIDS: integrating the four elements and including 
appropriate skills listt a on the simulator Instructor Skills 
Matrix, ar the exercise permits the students progresr>. 
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INITIATING CUE: 

Tha simulator instructor has completed the pre-exeroxse 
briefing. 

TERMINATING CUE: 

The students have achieved the exercise guide objectives and 
the simulator is freezed. 

OUTPUT/OUTCOME OP TASK: 

The student team members have achieved the exercise guide 
performance objectives and improved their watchstanding 
skills. 

KOTE: SEE SQIOC MODEL ATTACHED 

PERFORMANCE CHECKLIST: 
u.. Observe students. 

2. Question students. 

3. Coach students. 

4. Intervene to correct. 

CONSEQUENCES OP INADEQUATE PERF^aUO^CE : 

The simulator instructor facilitates negative training. 
The students' transfer negative learning to the plant control 
room that results in a performance error • 

S2^ETY CONSIDERATIONS: Negative training that results in a 
performance error on-the-job can jeopardize the safe and stable 
status of the plant. 

AFFECTIVE INDICATORS: The simulator instructor: 

role models confidence and competence in all positions. 

complies with company policies and procedures*. 

encourages individual operators to think and operate at a level 

above that expected, 
discourages and debates irrational operator actions, 
resolves conflicts, between student tea^i members, that are 

negatively impacting tears performance, 
resists conflict with students that may have a negative impact 

on learning. 

coach in the use of coding and diagnostics to reduce 

unwarranted levels of stress, 
encourages individual initiative. 

uses praise and criticism that is always constructive (focuses 
on performance related to the objectives, not the person.) 

implements all instructor cues in exercise guide. 

fully and consistently implements SQIOC process. 

self-evaluates SQIOC behavior/performance and strives to 
improve. 
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HUMAN INTERFACES i The simulator instructor, as a facilitator of 
trail ing, interfaces with diverse target populations of simulator 
training , including : 

-Hot license candidates 

-Licensed operators (RO and SRO) 

-Shift Technical Advisors 

-Technical Staff 

-Managers 

-Other simulator instructors 

-Other Operator Training instructors 

REQUIRED TOOLS/EQUIPHENT/HATERIALS: 

Approved exercise guide and any required supplementary 

references (e.g. Watchstanding Skills Matrices, evaluation 
forms.) 

GENERAL REFERENCES: 

AUTHORITY REFERENCES: 

INPO 86-026, Guidelines for Simulator Training 

SELECTED REFERENCES: 

Allen, D.W. "Micro-teaching: A new framework for in- 
service education." In Cooperative Curriculum Center, Synopsis 
of the taxonomy of cmestions . Title III ESEA III Project of ^ESA 
#10, Washington, D.C.: Office of Education, Department of 
Health, Education and Welfare, [n.d.] 

Alleu, D.W., Ryan, K.A., Bush, R.N. & ::ooper, J.M. "Pro- 
posed clusters of technical skill." In Cooperative Curriculum 
Cen"^;er. Synopsis of taxonomy of questions . Title III ESKi Project 
of CESA #10, Washington, D.C.: Office of Education, Department 
of Health, Education and Welfare, [n.d.] 

Cooper, J.M. "De"3loping specific teaching skills through 
micro-teaching." In Cooperative Curriculum Center, Synopsis of 
taxonomy of questions . Title III ESEA Project of CESA #10, 
Washington, D.C.: Office of Education, Department of Health, 
Education and Welfare, [n.d.] 

Cooperative Curriculum Center. Synopois of the taxonomy of 
questions . Title III ESEA reject of CESA #10, Washington, D.C.: 
Office of Education, Department of Health, Education ond Welfare, 
[n.d.] 

Davis, L.T., Gaddy, CD., Turney, J.R. , & Koontz, J.L. 
"Team skills training," Performance and Instruction J o urnal . 
October 1986,25 (8), 12-17. 
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Eyseuck, M. Handbook of- cognitive psychology ^ Hillsdale^ 
New Jersey; L. Erlbaiom and Associated^ 1984* 

Hedegard^ J. Training of control room crews in plant 
disturbance diagnosis ~ a methodological framework ^ Stockholm^ 
Sweden: Swedish Nuclear Power Inspectorate^ February^ 1987. 

Krahenbuhl, G.S., Darst, P.W. , Marett, J.R., Reuther, L.C., 
Constable^ S.H. Swinford, M.E. & Reid^ G.B. "Instructor pilot 
teaching training/' Aviation, Spac e ^and Environmental Medicine ^ 
October 1981, 594-597. 

Rasmussen, J. On information processing and man-made 
interaction ^ Riso; Riso National Lab., 1984. 

Sanders, N.M. Classroom questions; What kinds? New York; 
Harper & Row, 1966. 

Spettell, CM. & Liebert, R.M. "Training for safety in 
automated person - machine systems, American Psychologist ^ May 
1986, 41 (5), 545-550. 



Welford, A. T. Skilled performance; Perceptual and motor 
skil ls, Glenview, 111.; Scott, Foresman and Company, 1976. 



JOB ANALYSIS DATA; 
FPL STUD Y; 



ID# TASK/ELEMENT/SKILL 

DIPPICULTY YES /NO 

E-3 (S) Perform instructor role play No 

E-4 (S) Execute demonstration exercise guide No 
E-5 (S) Modify exercises based on student feedback No 
E-o Modify exercises when recognize simulator 

conditions approach ATP boundaries Yes 
E-7 (S) Determine data for feedback on c jerator 

performance " No 

E-8 (E) Question students as necessary yes 

E-9 (E) Coach students as appropriate yes 

E-10 (S) Reinforce team skills Yes 

E-11 (E) Intervene to foster team interaction Yes 

E-IJ (S) Intervene to assess cognitive skills Yes 

E-13 (S) Develop student diagnostic abilities Yes 

E-14 (S) Develop student perceptual coding skills Yes 

E-15 (S) Develop stress management skills Yes 

E-16 (S) Execute lab exercise guide No 

E-17 (S) Execute practice exercise guide No 
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SIMULATOR INSTRUCTOR TASK ANALYSIS TRACKING NO. A-4 

E-18 (S) Deteinnine data for feedback on operator 

perceptual coding Yes 

E-19 (S) Recognize/act on simulator conditions which 

diverge from expected responses Ygs 

CAPABILITY LEVEL (expected result of initial training) 

1 = Prerequisite to initial training 

2 = Knowledge only 

3 = Skilled execucion with assistance 

4 = Skilled execution, independently 

5 = Mastery required 

LEVEL 



E-3 (S) Perform instructor role play 4 

E-4 (S) Execute demonstration exercise guide 4 

E-5 (S) Modify exercises based on student feedback 3 
E-6 (S) Modify exercises when recognize simulator 

conditions approach ATP boundaries 3 
E~7 (S) DeterJiine data for feedback on operator 

performance 4 

E-8 (E) Question students as necessary 4 

E-9 (E) Coach studenrs as appropriate 4 

E-10 (S) Reinforce team skills 4 

E-11 (E) In::ervene to foster team interaction 4 

E-12 (S) Intervene to assess cognitive skills ^ 

E-13 (S) Develop student diagnostic abilities 4 

E-14 (S) Develop student perceptual coding skills 4 

E-15 (S) Develop stress management skills 4 

E-16 (S) Execute lab exercise guide 4 

E-17 (S) Execute practice exercise guide 4 
E-18 (S) Determine data for feedback on operator 

perceptual coding 4 
E-19 (S) Recognize/act on simulator conditions which 

diverge from expected responses 4 
Write-in: (E) Observe students 



REITMEYER STUDY : 



ID# TASK/ELEMENT/SKILL SUPV SME COMB 

IMPORTANCE (to succe'^^s of simulator instructor) 
E-3 (S) Act as fill-in during trng. or testir 
E-4 (S) Execute lesson plans/scenarios 

E-5 (S) Adapt scenario based on stud, response 3.54 ?.44 3.46 
E-6 (S) Adapt to simulator anomalies 
E-7 (S) Collect data for evaluation/critique 
E-8 (E) Question individuals as appropriate 
E-9 (E) Tutor individuals as appropriate 
E-10 (S) Reinforce t^am skills 
E-11 (E) Limit intervention to foster t^.am 
interaction 



2 


.16 


2 


.27 


2 


.24 


3 


.49 


3 


.37 


3 


.40 


3 


.54 




.44 


3 


.46 


3 


.45 


3 


.28 


3 


.32 


3 


.08 


2 


.97 


3 


.00 


3 


.47 


3 


.00 


3 


.35 


3 


.46 


3 


.48 


3 


.47 


3 


.29 


3 


.33 


3 


.32 


3 


.19 


3 


.08 


3 


.11 
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IMPACT ON LEARNER 





•3 


(S) 


Act as fill-in during trng or testing 


2 


.18 


2. 


29 


2.26 


JZi 


•A 










J . 


JO 


J.JO 


E- 


•5 


(S) 


Adapt scenario based on stud, response 


3 


.56 


3. 


36 


3.41 


E- 


■6 


(S) 


Adapt to simulator anomalies 


3 


.40 


3. 


25 


3.29 


E- 


•7 


(S) 


Collect data for evaluation/critique 


3 


.10 


2. 


82 


2.89 


E- 


•8 


(E) 


Question individuals as appropriate 


3 


.42 


3. 


36 


3.38 


E- 


■9 


(E) 


Tutor individuals as appropriate 


3 


.58 


3. 


57 


3.57 


E- 


•10 


(S) 


Reinforce team skills 


3 


.37 


3. 


34 


3.35 


E- 


•11 


(E) 


Limit intervention to foster team 


















interaction 


3 


.17 


3. 


07 


3.10 






DIFFICULTY 












E- 


•3 


(S) 


Act as fill-in during trng or testing 


1.82 


1. 


98 


1.94 


E- 


■4 


(S) 


Execute lesson plans/scenarios 


2 


.59 


2. 


60 


2.69 


E- 


■5 


(S) 


Adapt scenario based on stud, response 


3 


.24 


3, 


12 


3.15 


E- 


•6 


(S) 


Adapt to simulator anomalies 


3 


.19 


3. 


13 


3.14 


E- 


•7 


(S) 


Collect data for evaluation/critique 


2 


.71 


2. 


59 


2.62 


E- 


•8 


(E) 


Question individuals as appropriate 


2 


.66 


2. 


71 


2.70 


E- 


•9 


(E) 


Tutor individuals as appropriate 


2 


.75 


2. 


83 


2.81 


E- 


■10 


(S) 


Reinforce team skills 


3 


.00 


2. 


83 


2.87 


E- 


•11 


(E) 


Limit intervention to foster team 


















interaction 


2 


.66 


2. 


66 


2.66 



RECOMMENDED INSTRUCTIONAL SETTING! Combination Classrooxa & 

Simulator 

RECOMMENDED PER'fORMANCE EVALUATION MODE: 

(X) Perform (X) Simulate ( ) Discuss 
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Task Worksheet fPart II) 

TASK ELEHElTJfS/aTANDARDS/PROBLEM ASSESSMENT/PROBLEM RESOLUCIOH: 
X. Observe tudentr^^ 
Standards; 

- positioned self strategically to visually assess ?tudont 

actions . 

« used observe cues required in the exercise guide, 

- critically listened. 

Problem Assessment: 

a. What would you do if your strategic positioning was 

interfering with student performance? 

b. would you do if you missed ar> Observe cue required in 
the exercise guide? 

c. What would you do if during the exercise you are not sure 

why a student has taken a particular action that iseems 
to be negatively affecting individual or team 
performance? 

d. what would you do if it became difficult to determine the 

appropriate amoimt of notes -to record? 

e. What would you due xn the event that both individual and 

team perfor-iance during a practice exerci.se is 
effectively achieving the objectives (i.e. no 
performance errors)? 

f . What if you must observe two or more students in different 

2:oles who are performing d.ifferent tasks, and you find 
it difficult to observe all required behaviors? 

Problem Resolution ; 

a. Move out of the way, and observe the student to deter aiine 

if your interference was detrimental to the achievement 
of the exercise objectives, if so, question and ;:oach 
the student in order to facilitate student success and 
def er/eiiminate unnecessary stress. 

b. Question other simulator instructors (if present) or the 

student to determine if the required behavior specified 
in the Observe cue had actually occurred. 

c. Question the student to determine "why" without interfer- 

ing/detracting the student. In some cases, it is 
important that you know the reason why a student har 
taken certain actions in order for you to fully 
determine proper coding. 

d. Focus your note-taliing on the objectives and the items 

included in the Watchstanding Skills Matrices. 

e. Maintain correct strategic posiA:ioning that does not 

interfer or distract the high quality of this effective 
team performance. 
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f . Pla, your observation strategy using the sequence of 

events ; cues, and expected student acti-ons that are 
15 ^ted in the exercise guid : then position yourself 
appropriately in order to oi serve the student (s) 
actions taken in response to critical incidents as 
specified in the guide. 

2. Question students. 

Standards ; 

- used lew- and high-orc^ered probing. 

- practiced pre-cueing. 

- asked questions included in the exercise guide. 
Problem Assessment ; 

a. What if a student jumped to a conclusion/solution to a 

problem without fully diagnosing tlie root cause or 
assessing the impact from an integrated systems 
perspective? 

b. What if the student cannot relate the existing data and 

information to his existing schema of the situation? 

c. Why, at appropriate times during an exercise, is it 

important that yea assess at which specific cognitive 
level a student is thinking? 

d. What if you asked a question that could not be readily 

answered, and you noticed that the student *s stress 
level was rising (i.e. you were distracting the 
:tudent's concentration during real time - mental 
intervention) ? 

e. What if you noticed that you were questioning too much on 

the same parameter/ indicator /topic? 

f . How can you determine at which cognitive level you should 

begin your questioning routine with a particular 
student? 

Problem Resolution s 

a. Question the student to check/assess what schema he is 

using, what data he has collected and is using, and why 
he has converged on a particular solution? 

b. Question to assess the existing schema being used by the 

student and coach in order to correct any misunder- 
standing of normal and the current situation. 

c. 1) so you can develop the student's thinking ski .Is; 

2) so you are cognizant of the student ^s current level of 
thinking, and can contrive situations in the 
"knowledge-ba-^"-^" dimension for the student to 
experience during training; 

3) so you can help to reduce any unnecessary high stress 
levels of student *s during training; and more 
importantly, reduce the likelihood of negative stress 
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on-the-job by providing opportuniti^ s to experience 
situations in the "knowledge-bar dimension that can 
occur on-the-job. 

d. Use the pre-cueing technique^ that is^ inform the student 

that you will expect the answer later* Be certain that 
you follow through; ask the question again at a more 
appropriate time. 

e. Stop questioning^ reflect bad: on vhat you just accomp- 

lished^ develop a strategy and begin again ^ being 
certain that you follow through to achieve the purpose 
of your questioning routine. 

f . Consider the Frame of Reference of the particular target 

population. Use the top-down approach by starting at 
an appropriate higher level and moving down until you 
locate the student's current level of thinking; or^ use 
the bottom-up approach by starting with questions at 
the Knowledge Level and moving up. 

3. Coach students* 

Standards ; 

- hinted facts, 
prompted strategies. 

- used Coding cues in the exercise guide. 

- used Socratic Method. 

- achieved student closure. 

Problem Assessment ; 

a. What if the student does not practice good communication 

skills while currently involved in an in-depth 
diagnostic routine? 

b. What if you recognize that your coaching is moving in the 

direction toward a mental intervention? 

c. What if a student asks you a question that you canuot 

immediately answer? 

Proble:a Resolution ; 

a. Provide little coaching on the expected communication 
behavior at that time^ then when the student has 
completed the diagr:)stic routine^ discuss the incident 
of poor communication in order to correct perf^nnance. 
b. Use the pre-cueing technique^ stop the discussiow and 
inform the student that you expect the answer later. 
Be certain to follow-through; at a more appropriate 
time restart the discussion. 

c. Tell the student that you do not know the answer at that 
time and (if possible) that you will locate the answer 
and g^.t back to him before the exercise is over or 
during the critique^ or make a note and follow-up after 
the exercise. 
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4* Intervene to correct. 
Standard. 

- performed prior to the student's inc .rrect actiono (verbal) 

- performed during real time^ (physical) unless appropriate 

to freeze simulator. (Big picture) 

- based on cues ir the exercise guide. 

Problem Assessment : 

a. What if during your c^aohing routine you notice that the 

student is mentally blocked? 

b. What if the student is about to operate equipment that 

could result in damage or personnel inj?zry? 

c. What if the team is not performing in accordance with the 

expected behavior as defined in the Watchstanding 
Skills Matrix? 

d. What if the team is implementing a solution to a iiis- 

diagnosed problem? 

Problem Resolution ; 

a. Mentally intervene. Explain to the student the correct 

information and why it is correct. Discuss and ask 
questions in order to achieve closure. Be certain to 
facilitate a smooth transition back to real time. 

b. Prevent the operation by phy.s;ically intervening^ tell the 

student what he was about tc do wrong and why it is 
wrong^ then tell the student how to do it correctly. 
Demonstrate if necessary. Be certain to question the 
student in order to assess if closure is c^chieved^ then 
transition smoothly back to real time. 

c. Overall poor team performance may be coriected by using a 

physical interve.*tion. Get the attention of all team 
members^ then explain what is expected that is not 
occurring and why it is important. Refer to the Watch- 
standing Skills Matrix^ describe your obsearvaticns^ be 
specific^ site con ^quences of inadequate performance 
on-the-job^ enpha^ 3 expectations^ answer any 
questions^ then trc4**3ition smoothly back to real time. 

d. Depending on the seriousness of the implementation^ and 

the degree of action required to recover from the 
situation and lead the team back toward the exercise 
objectives, a freeze intervention may be required. If 
so, freeze the simulator and get the attention of all 
team members. Assess why the team mis-diagnosed the 
probleui thro^^gh questioning and discussion. Clearly 
explain what they did wrong and why. Coach them back 
to the proper direction^ achieve closure and transition 
smoothly back to real time. 
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TASK ELEMENTS: 

GENERAL SKILLS TiND KNOWLEDGE 

(K) Explain what elements of a shift turnover must be 

included at the beginning of exercises. 
Identify the instructor's Shi^t Turnover activities in an 

exercise guide. 
Explain how a shift turnover during a simulator exercise 

is conducted 

Discuss the nature of the information processing model. 
Define the meaning of "coding". 

Discuss the role of "selection^ and "integration" in the 

coding process. 
Define the meaning of "schema". 
Discuss three types of schema traps. 
Discuss how "bias" affects coding. 

Explain the advaiitages arA disadvantages of schema. 
Site exajnples of the use of coding during a simulator 
exercise. 

Explain how proper coding can reduce stress and improve 

an operator's performcince. 
List behavior cues which indicate a student may have a 

coding problem. 
Define the meaning of "programming of action^\ 
Explain why it is :.mportant to utilize "programming of 

action" during a simulator exercise. 
Distinguish betweien rule^based and knowledge-baser! data 

management. 

Identify four sources of data input to a human ^s coding 
process. 

Construct a diagram of the human information processing 
model. 

Explain the two different diagnostic search routines. 
Distinguish between "algorithmic" and "heuristic" 

diagnostic rules. 
Describe the meaning of "negacive training". 
Explain when "negative training" could occur and who will 

prevent it. 

Identify examples of operational team skills. 
Explain when stress occurs. 

Identify instructor behaviors that positively and 
negatively affect student stress (i.e. commands, 
instructional cues, questions, acceptance, praise- 
general/specif Ic , correction , scold-general/specific 
modeling-posxtive/negative. ) 

Identify instructor cues in exercise guide (i.e. Action, 
Observe, Role Play, Coding.) 
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(S) Model positive operat'ir behavior. 

Execute Demonstration^ Lab^ and Practice exercise guides. 

Modify exercises based on student feedback. 

Modify exercises when recognize simulator conditions 

approach Acceptance Testing Program (ATP) boundaries. 
Use Watchstanding Skills Matrices. 
Use Team Skills Matrix. 

Investigate root canse of perfonnw^nce problem. 
Use SQIOC to develop correct strategies. 
Execute a strategy to correct cognitive errors. 
Use micro-teaching to develop /improv:. SQIOC skills and 
technique. 

Provide positive feedback to reduce s cress. 
Maintains realistic control room setting to manage 

stress/resources. 
Role model ANFS/other staff as Role Play cues specify in 

exercise guide. 
Use Action cues in exercise guide to achieve sequence of 

events . 

Locate, interpret and use "Optional instructor activity/- 
student activity" cues supplemental to basic simulator 
exercise. 

Nc^teta): ' ng 

!• Observe students. 

SKILLS AND KNOWLEDGE ; 

Define the purpose of instructor "observation" during the 

performance of SQIOC. 
List observation techniques that the simulator instructor 
utilizes during an exercise and explain how each can be 
applied to various situations. 
Explain how proper observation skills can contribute to 

team building during a simulator exercise. 
Expl?.in the importance of instructor strategic positioning 
Identify student cues which indicate: 
-confusion; 
-apprehens ion ; 
-lack of confidence; 

-perJJormance resulting from poorly coded framework; 

-performance resulting from properly coded framework. 
Recognize Normal Operations . 
Recognize Of f -Normal/ Emer;^<?.ncy Operations. 

(S) Locate self in a strategic position at the propca- nime. 
Use critical and active listening skills. 
Determine data for feedback on operator performance. 
Determinj^i data for feedback on operator's coding ability. 
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Develop students' diagnostic abilities. 
Develop students* ceding ability. 
Develop stress management skills. 

Recognize students' eye movement^ visual cues, non-verbal 

cues, professionalism. 
Monitor technical performance using Watchstandlng Skills 

Matrices. 

Monitor communications using Watchstandlng Skills Matrix. 
Use Observe cues in exercise guide. 

2« Question students. 

3KILLS AND KNO^^EDGE; 

(K) Define the purpose of instructor "questioning" during the 
performance of SQIOC. 
List and distinguish between the levels of the questioning 
hierarchy. 

Site an identifying characteristic and example of each 
level of the questioning hierarchy. 

Define the ;<^aning of "achieving closure". 

Explain how le questioning hierarchy can be used effec- 
tively to achieve closure during an exercise. 

Define the meaning of "pro-cueing". 

Discuss the advantages of using pre-cueing as a question- 
ing technique. 

Explain how "pre-cueing" can contribute to the development 

of team building during an simulator exercise. 
Define what is meant by "probing quesrions". 
List methods of probing questioning. 

List the elements of the "inquiry development" technique. 

(S) Use SQIOC process to detemodine appropriate level of 
questioning. 
Use the pre-cueing technique. 
Use probing questioning techniques. 

Construct questions consistent with the exercise objec- 
tives. 

Construct questions consistent with intended leve? of 
questioning. 

Ask questions at the proper time without interfering with 

student operations. 
Ask questions to assess student's current level of 

thinking. 

Use the inquiry development echnique. 
Use the planned repetition t chnique. 
Reinforce team skills. 

Develop students' diagnostic abilities. 
Develop students' coding ability. 
Develop stress management skills. 
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Use Coding cues in an exercise guide to formulate 
questions. 

Assess achievement of closure through questioning. 
Directs questions at target population* 

3« Coach students* 

SKILLS AND KNOWLEDGE; 

(K) Define the purpose of instructor "coaching" during the 
performance of SQIOC. 
Distinguish between the different levels of coaching 
involvement. 

Explain how th.^ instructor can generate "student-initiated 
questioning^^ and why this is advantageous. 

Explain how proper coaching will prevent operator (target 
population) apprehension and build confidence in 
actions. 

Explain how the instructor can minimize stress and 
maximize operator (target population) performa.ice 
during a simulator exercise. 

Explain what is meant by the term "synergy" and "group 
think". 

List what diagnostic schemes can be utilized to solve 
plant problems during a simulator exercises. 

Given a plant problem, explain which diagnostic scheme 
should be used and justify you choice. 

(S) Use SQIOC process to determine level of ccacl'^rr. 

Coach at the proper time without impeding flow of exercise 

or interfe-.'ing with student operations. 
Reinforce team skills. 
Develop students » diagnostic abilities. 
Develop students^ coding ability. 
Develop stress management skills. 
Use inductive and deductive uses of examples. 
Facilitate achieving closure for students. 
Use instructional cues. 
Provide positive^ constructive feedback. 
Use Role Play cues in exercise guide to coach students. 
Develop individual efforts into a synergistic effort. 
Coaches both prior to and during evolution^ as 
appropriate 

Coaches within target population's Frame of Reference 
Does not interfere with student when student has situation 
under control. 
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4. Intervene to correct* 

SKILLS AND KNOWLEDGE: 

(K) Define the pujrpose of instructor "intervention" during the 

performance of SQIOC* 
Distinguish between the three types of intervention 

jiethods (i.e. mental^ physical, freeze.) 
Discuss the meaning of the concept "operator as a manager 

of systems." 

Explain how proper instructor intervention can be per- 
formed during a simulator exercise to promote the idea 
of an operator as a "manager of systems". 

Explain why intervention should be used judiciously during 
a simulator exercise. 

Explain how excessive intervention may result in a 
negative learning experience. 

Recognize performance that indicates a ceding or cognitive 
error that requires intervention. 

(S) Use SQIOC process to deteirmine appropriate^ intervention. 
Reinforce team skills. 

Foster team interaction using intervention techniques. 
Assess cognitive skills using inrervention techniques. 
Develop students* diagnostic abilities. 
Develop students* coding ability. 
Develop stress management skills. 

Recognize/act on simulator conditions wliich diverc^e from 

expected responses. 
Establish conditions at end of intervention routine and 

continue ekercise. 
Recognize nc^gative training occurring. 
Prevent/recover from negative learning experience. 



SIMULATOR INSTRUCTOR 



TASK ANALYSIS 



TRACKING NO. A-4 



RESC :i RCE WORKSHEE T 
RESOORCES FOR DEVELOPMENT: 

OWN resources: 

1. SQIOC Model 

2. Questioning Exercii^es 

3. Watchstanding' Skills Matrices 

OTHER RESOURCES: (If used, copyright permission may be required) 



GENERAL SKILLS AND KNOWLEDGE 

EXPLAIN WHAT ELEMENTS OF A SHIFT TURNOVER MUST BE INCLUDED 
IN THE BEGINNING OF EXERCISES . ELEMENTS ARE IN EACH EXERCISE 
GUIDE FOR PRESENTATION; REF. SIMULATOR EXERCISE GUIDE. 

IDENTIFY THE INSTRUCTOR'S SHIFT TURNOVER ACTIVITIES IN AN 
EXERCISE GUIDE. ELEMENTS ARE IN EACH EXERCISE GUIDE FOR 
PRESENTATION; REF. SIMULATOR EXERCISE GUIDE. 

EXPLAIN HOW A SHIFT TURNOVER DURING A SIMULATOR EXERCISE 
GUIDE IS CONDUCTED. ELEMENTS ARE IN EACH EXERCISE GUIDE FOR 
PRESENTATION: REF. SIMULATOR EXERCISE GUIDE 

DISCUSS THE NATURE OF A INFORMATION PROCESSING MODEL. RE|\#1 
SKILLED PERFORMANCE; PERCEPTUAL AND MOTOR SKILLS PG.'S 1-35. 

DEFINE THE MEANING OF "SCHEMA" . REF. .^1 SKILLED 
PERFORMANCE; PERCEPTUAL AND MOTOR SKILLS PG.'S 19-32. 

DISCUo'S THE ROLE OF "SELECTION" AND "INTEGRATION" IN THE 
CODING PROCESS. REF. #1 SKILLED PERFORMANCE; PERCEPTUAL AND 
MOTOR SKILLS PG.'S 2-28. 

DISCUSS THREE TYP US OF SCHEMA TRAPS. REF.#1 SKILLED 
PERFORMANCE; PERCEPTUAL AI'TD MOTOR SKILLS PG.'S 10-16.30-32. 

DISCUSS HOW BIAS AFFECTS SCHEMA. REF. #1 SKILLED PERFORMANCE; 
PERCEPTUAL AND MOTOR SKILLS PG.'S 30-32. REF. #2 NATURE AND 
STRUCTURE OF KNOWLEDGE PG.'S 9-14. 

EXPLAIN THE ADVANTAGES AND DISADVANTAGES OF SCHEMA. REF. #1 
SKILLED PERFORMANCE; PERCEPTUAL AND MOTOR SKILLS PG.'S 10- 
16. 30-32. REF. #2 MATURE AND STRUCTURE OF KNOWLEDGE PG.'S 9- 
14. 



TASK ANALYSIS K&A REFERENCES 




ERIC 



• 



SIMULATOR INSTRUCTOR TASK ANALYSIS TRACKING NO. A-4 

SITE EXAMPLES OF THE USE OF CODING (SCHEMA) DURING A 
SIMULATOR EXERCISE. REF. SIMULATOR PRACTICE EXERCISE GUIDE 
HAS CODING AS AN INSTRUCTIONAL CUE. 

EXPLAIN HOW PROPER CODING CAN REDUCE STRESS AND IMPROVE AN 
OPERATORS PERFORMANCE. REF. #1 SKILLED PERFORMANCE; PERCEPTUAL 
AND MOTOR SKILLS i:>G.'S 30-32. REF. #2 THE NATURE AND STRUCTURE 
OF KNOWLEDGE PG.'S 18. 19. REF. #6 TRAINING FOR SAFETY IN 
AUTOMATED PERSON-MACHINE SYSTEMS . f ALL) . 

LIST BEHAVIORAL CUES WHICH INLICATE A STUDENT MAY HAVE A 
CODING PROBLEM. REF. #4 EXCERPTS FROM SYNOPSIS OF THE TAXON OMY 
OF QUESTIONS PG.'S 1.3.4.6. 

DEFINE THE MEANING OF THE TERM "PROGRAMMING OF ACTION". REF. 
SUMMARY PG.3. 

EXPLAIN WHY IT IS IMPORTANT TO UTILIZE "PROGRAMMING OF 
ACTION"DURING AN SIMULATOR EXERCIJE. REF. SUMMARY PG.3. 

DISTINGUISH BETWEEN RULE-BASED AND KNOWLEDGE BASED DATA 
MANAGEMENT . REF. NO REFERENCE IN READING MATERIALS. 

IDENTIFY FOUR SOURCES OF DATA INPUT TO A HUM^N•S CODING 
PROCESS . REF.#1 SKILLED PERFORMANCE ; PERCEPTUAL AND MOTOR 
SKILLS PG.'S 1-6 . (ADDITIONAL INFORMATION NECESSARY. THE 
MODEL WHICH WAS GENERATED DURING SEMINAR. ADEQUATE) . 

CONSTRUCT A DIAGRAM OF THE HUMAN INFORMATION PROCESSING 
MODEL . REF. #5 TRAINING OF CONTROL ROOM CRE^vS IN PLANT 
DISTURBANCE DIAGNOSIS- A METHODOLOGICAL FRAMEWORK PG.'S 4-11 
(NEED TO USE MODEL GENERATED DURING SEMINAR) . 

EXPLAIN THE TWO DIFFERENT DIAGNOSTIC SEARCH ROUTINES . REF. #5 
TRAINING OF CONTROL ROOM CREWS IN PLANT DISTURBANCE 
DIAGNOSIS-A METHODOLOGICAL FRAMEWORK PG.'S 11-15 . 

DISTINGUISH BETWEEN "ALGORITHMIC AND HEURISTIC"^ DIAGNOSTIC 
RULES . REF. #5 TRAINING OF CONTROL ROOM CREWS IN PLAN T 
DISTURBANCE DIAGNOSIS- A METHODOLOGICAL FRAMEWORK PG.'S 11- 
15. 

DESCRIb^ THE MEANING OF "NEGATIVE TRAINING" . REF. SUMMARY 
PG. 'S 1-8. 

EXPLAIN WHEN " NEGATIVE TRAINING" COULD OCCUR AND WHO WILL 
PREVENT IT. REF. SUMMARY PG.'S 1-8. 

IDENTIFY EXAMPLES OF OPERATIONAL TEAM SKILLS. REF. #8 PG. 13. 
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EXPLAIN WHEN STRESS OCCURS. REF. #6 TRAINING FOR SAFETY IN 
AUTOMATED PERSON-MACHINE SYSTEMS PG,'S 5 47.548 REF.#7 
INSTRUCTOR PILOT TEACHING BEHAVIOR ANr- STUDENT PILOT STRESS 
IN FLIGHT TRAINING ALL. 

IDENTIFY INSTRUCTOR BEHAVIORS THAT POSITIVELY AND NEGAI'IVELY 
AFFECT STUDE7JT STRESS . REF . #7 INSTRUCTOR PILOT TEACHING 
BEHAVIOR AND STUDENT PILOT STRESS IN FLIGHT TRAINING. PG. 
595. 

IDENTIFY INSTRUCTIONAL CUES IN AN EXE. USE GUIDE. EEFs. 
SIMULATOR EXERCI S E GUIDE. 

MODEL POSITIVE OPERATOR BEHAVIOR. REF. #7 INSTRUCTOR PILOT 
TEACHING BEHAVIOR AND STUDENT PILOT STRESS IN FLIGHT 
TRAINING. PG. 595;REF.4 EXCERPTS FROM SYNOPSIS OF THE 
TAXONOMY OF QUESTIONS PG.'S 1-4. 

EXECUTE DEMONSTRATION, LAB AND PRACTICE EXERCISE GUIDES. REF. 
SIMULATOR EXERCISE GUIDE. 

MODIFY EXERCISES BASED ON STUDENT FEEDBACK. REF. NO Ri3FERENCE 
READING. 

MODIFY EXERCISES WHEN RECOGNIZED lilMULATOR CONDITIONS 
APPROACH ACCEPTANCE TESTING PROGRAM BOUNDARI ES . REF . NO 
REFERENCE READING. 

USE WATCHSTANDING SKILLS MATRIX. REF. WATCHSTANDING SKILLS 
MA TRIX; REF. #8 TEAM SKILLS TRAINING ALL. 

INVESTIGATE ROOT CAUSE OF PERFORMANCE PROBLEM. REF. #4 
EXCERPTS FROM THE SYNOPSIS OF THE TAXONOMY OF QUESTIONS 
PG.'S 3-9; SOIOC MODEL. 

USE SQIOC TO DEVELOP CORRECT STRATEGIES. REF. SOIOC MODEL IN 
CONJUNCTION WITH SEMINAR; REF. #3 EXCERPTS FROM A SYNOPSIS OF 
THE TAXONOMY OF QUESTIONS ALL. 

EXECUTE A STRATEGY TO CORRECT COGNITIVE ERRORS. REF. SOIOC 
MODEL IN CONJUNCTION WITH SEMINAR; REF. #3 EXCERPTS FROM A 
SYNOPSIS OF THE TAXONOMY OF QUESTIONS ALL. 

USE MICRO-TEACHING TO DEVELOP/IMPROVE SQIOC SKILLS AND 
TECHNIQUE . REF. #4 EXCERPTS FROM SYNOPSIS OF THE TAXONOMY OF 
QUESTIONS PG.'S 16-19; SOIOC MODEL IN CONJUNCTION WITH 
SEMINAR. 
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PROVIDE POSITIVE FEEDBACK TO REDUCE STRESS. REF, INSTRUCTOR 
PILOT TEACHING BEHAVIOR AND STUDENT PILOT STRESS IN FLIGHT 
Ti^ AINING. ALL. 

MAINTAINS REALISTIC CONTROL KOOM SETTING TO MANAGE 
STRESS /RESOURCES. REF. NO READING MATERIAL REFERENCES, 

ROLE MODELS ANPS/OTHER STAFF AS ROLE PLAY CUES SP2CIFY IN 
EXERCISE GUIDES. REF. SIMULATOR EXERCISE GUIDE; REF, /8 TEAM 
SKILLS TRAINING PG.'S 15-16. 

USE ACTION CUES IN EXERCISE GUIDE TO ACHIEVE SEQUENCE OF 
EVENTS . REF. SIMULATOR EXERCISE GUIDE?REF.#8 TEA M SKILLS 
TRAINING PC^S 15-16. 

LOCATE, INTERPRET AND USE "OPTIONAL INSTRUCTOR 

ACTIVITY/ STUD EN?.' ACTIVITY" CUES SUPPLEMENTAL I'O THE BASIC 

SIMULATOR EXERCISE GUIDE. REF, SIMULATOR EXERCISE GUIDE. 



1, OBSERVE STUDENTS 

DEFINE THE PURPOSE OF INSTRUCTOR OBSERVATION "lURING THE 
PERFORMANCE OF SQIOC. REF, SOIOC MODEL IN CONJUNCTION WITH 
SEMINAR: REF. #4 EXCERPTS FROM SYNOPSIS OF THE TAXONOMY OF 
QUESTIONS PC'S 1-4. 

LIST THE OBSERV/iTION TECHNIQUES THAT THE SIMULATOR 
INSTRUCTOR UTILIZES DURING AN EXERCISE AND EXPLAIN HOW ^=?iOH 
CAN BE APPLIED TO VARIOUS SITUATIONS , REF , SOIOC MODEL IN 
CONJUNCTION WITH A SEMINAR ? REF. #4 EXCERPTS FROM SYNOPSIS OF 
THE TAXONOMY OF OUESTIONS ALL, 

EXPLAIN HOW PROPE"^ OBSERVATION SKILLS CAN CONTRIBUTE TO TEAM 
BUILDING DURING AN EXE"JICISE GUIDE, REF. #4 EXCERPTS FROM 
SYN OPSIS OF THE TAXONOMY OF OUESTIONS PG, 4, 

EXPLAIN THE IMPORTANCE OF INSTRUCTOR STRATEGIC 

POSITIONING. REF, #4 EXCERPTS FROM SYNOPSIS OF THE TAXONOMY OF 

OUESTIONS PG. 1? IN CONJUNCTION WITH SOIOC MODEL, 

IDENTIFY STUDENT CUES THAT INDICATE; CONFUSION, APPREHENSION 
OR LACK OF CONFIDENCE; POOR CODED r'RAMEWORK/ PROPER CODED 
FRAMEWORK, REF,;.'?4 EXCERPTS FROM THE SYNOPSIS OF THE TAXONOMY 
OF OUESTIONS PG, 1; SUMMARY PG> 1, 

RECOGNIZE NORM/iL OPERATIONS, REF. NATURE AND STRUCTURE OF 
KNOWLEDGE PG.'S 14-19, 
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RECOGNIZE OFF-NORMAL/ EMERGENCY OPERATIONS. REF. #2 NATURE ANp 
STRUCTURE OF KNOWLEDGE PC'S 14-19. 

LOCATES SE"^F IN A STRATEGIC POSITION AT THE PROPER 
TIME . REF.#4 EXCERPTS FROM SYNOPSIS OF THE TAXONOMY OF 
QUESTIONS PG.'S 1-4 r IN CONJUNCTION WITH SOIOC MODEL AWn 
SEMINAR. 

USES ACTIVE LISTENING. REF. NO REgERENCE READING. 

DETERMINE DATA FOR FEEDBACK ON OPERATOR PERFORMANCE . REF . 
SIMULATOR PRACTICE EXERCISE GUIDE. 

DETERMINE DATA FOR FEEDBACK ON OPERATORS CODING ABILITY. REF. 
SIMULATOR PRACTICE EXjIRCISE GUIDE. 



DEVELOP STUDENT'S DIAGNOSTIC ABILITIES. REF. #5 TRAINING OF 
CONTROL ROOM CREWS IN PIAMT DIAGNOSIS- A METHODOLO GICAL 
FRAMEWORK PG.'S ALL. 



DEVELOP STUDENTS CODING ABILITY. REF. #1 .y ^ LLED PERFORMANCE: 
PERCEPTUAL AND MOTOR SKILLS PG.'^S ALL. 

DEVELOP STRESS MANAGE-^IFJiT PiClLLS.R EF. #6 TRAINING FOR SAFETY 
IN AUTOMATED PERSON-MACHINE SY STEMS ?G . 548;REF.#7 
INSTRUCTOR PILOT BEHAVIOR ANL STUDENT PILOT STRESS IN FLIGHT 
TRAINING. PG.'S ALL. 

RECOGNIZE STUDENT'S EYE MOVEMENT, VISUAL CUES, NON-VERBAL 
CUES AND PROFESSIONALISM. REF. #4 EXCERPTS FROM SYNOPSIS f 
THE TAXONOMY OF QUESTIONS P G .'S 1-4. 

MONITOR TECHNICAL PERFORMi^NCE USING WATCHSTANDING SKILLS 
MATRIX . REF. WATCHSTANDING SKILLS MATRIX AND SIMULATOR 
EXERCISE GUIDE. 

MONITOR COMMUNICATIONS USING WATCHSTANDING SKILLS 
MATR7X . REF. WATCHSTANDING SKILLS MATRIX. 

USE OBSERVE CUES IN THE EXERCISE GUIDE. REF. SIMULATOR 
EXERCISE GUIDE. 



2. QUESTION STUDENT'S 

DEFINE THE PURPOSE OF INSTRUCTOR "QUESTIONING" DURING Tllh 
PERFORMANCE OF 5QI0C. REF.#3 EXCERPTS FROM THE SYNOPSIS OF 
TAXONOMY OF QUEST I ONS PG.'S l-18rSQI0C IN CONJUNCTION WITH 
SEMINAR. 
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LIST AND DISTINGUISH BETWEEN THE LEV2LS OF THE QUESTIONING 
HIERARCHY . REFi^3 EXCERPTS FROM THE SYNOPSIS OF THE TAXONOMY 
OF QUESTIONS PG. 'S 1-18 

SITE AN IDENTIFYING CHARACTERISTIC AND EXZ\MPLE OF EACH LEVEL 
OF QUESTIONING HIERARCHY. REF . #3 EXCERPTS FROM THE SYNOPSIS 
OF TAXONOMY OF QUESTIONS PG. 'S 1-18. 

DEFINE THE MEANING OF "ACHIEVING CLOSURE". REF. #4 EXCERPTS 
FROM THE SYNOPSIP OF THE TAXONOMY OF QUESTIONS PG. fa. 

EXPLAIN HOW THE QUESTIONING HIERARCHY CAN BE USED 
EFFECTIVELY TO ACHIEVE CLOSURE DURING AN EXERCISE. H EF. i?4 
EXCERPTS FROM THE TAXONOMY OF QUESTIONING PG. 6; IN 
CONJUNCTION WITH A SIh"ULATOR EXERCISE rSUIDE. 



USE THE PRE-CUEING TECHNIQUE. REF. #4 EXCERPTS FROM THE 
SYNOPSIS OF TAXONOMY OF QUESTIONS ''C. ' 2.3. 

DISCrSS THE ADVANTAGES OF USING PRE-CUEING AS A QUESTIONING 
TECHN ''0UE. REF.#4 EXCERPTS FROM SYNOPSIS OF THE TAXONOMY CF 
QUESTIONS 

EXPLAIN HOW "PRE-CUEIilG" CAN CONTRIBUTE TO THE DEVELOPMENT 
OF TEAM BUILDING DURING AN EXERCISE SPJS5I0N. REF. NO 
REFERENCE IN THE READING MATERIALS. 



DEFINE WHAT IS MEANT BY "PROBING QUESTIONS" . REF. #4 EXCERPTS 
FROM SYNOPSIS OF THE TAXONOMY OF QUESTIONS PG. 4. 

LIST METHODS OF "PROBING QUESTIONS". REF. #4 EXCERPTS F ROM 
SYNOPSIS OF THE TAXONOMY OF QUESTIONS PG. 4. 

LIST THE ELEMENTS OF THE "INQUIRY TECHNIQUE" y^FTHOD . REF . NO 
REFERENCE IN READING. rNEED THE PAGE USED IN 8EV "'.NAR> 

USE THE SQICC PROCESS TO DETERMINE THE APPROPRIATE LF"^L OF 
QUESTIONING. REF. #3 EXCERPTS FROM SYNOPSIS OF THE TAXOuOMY OF 
Q UESTIONS. ALL; J.LSO NEED THE SQIOC MODEL IN CONJUlfCTION 
W ITH SEMINAR. 

USE THE PRE-CUEING TECHNIQUE. REF. #4 EXCERPTS FROM SYN O PSIS 
OF THE TAXONOMY OF QUESTIONS PG. 2. 

CONSTRUC'T QUESTIONS CONSISTENT WITH EXERCISE 

OBJECTIVES. REF. #3 EXCERPTS FROM '..HE TAXONOMY OF QUESTIONS 

ALL; SINTULATOR EXERCISE GUIDE. 



CONSTRUCT QUESTIONS CONSISTENT WITH THE LEVEL OF 
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QUESTIONING. REF. #3 .4 EXCERPTS FROM SYNOPSIS OF TAXONOMY OF 
OUESTIONS ALL. 

ASK QUESTIONS AT THE PROPER TIME WITHOUT INTERFERING WITH 
STUDENT OPERATIONS. REF. SIMULATOR EXERCISE GUIDE, SOIOC 
MODEL IN CONJUNCTION WITH SEMINAR. 

ASK QUESTIONS TO ASSESS STUDENT'S CURRENT LEVEL OF 
THINKING . REF. #3 EXCERPTS FROM SYNOPSIS OF THE TAXONOMY OF 
OUESTIONS ALL; SOIOC MODEL IN CONJUNCTION WITH SEMINAR. 

USE THE INQUIRY DEVELOPMENT TECHNIQUE REP. NO REFEREWCB 
READING. 

.'USE THE PLANNED REPETITION TECHNIQUE. REF. #4 EXCERPTS FROM 
' SYNOPSIS OF THE TAXONOMY OF OUESTIONS PG. 5. 

REINFORCE TEAM SKILLS. REF. #5 TRAINING OF CONTROL ROOM CREWS 
IN PLANT DISTURBANCE DIAGNOSIS-A METHODOLOGICAL FRAMEWORK 
PG.'S 15-20 ;REF#7 TEAM SKILLS TRAINING ALL. 

DEVELOP ox'UDENT DIAGNOSTIC ABILITIES. REF. #5 TRAINING OF 
CONTROL CREWS IN PLANT DISTURBANCE DIAGNOSIS-A 
METHODOLOGICAL FRAMEWORK PG.'S 15-20. 

DEVELOP STUDENT'S CODING ABILITY. REF. #2 THE NATURE AND 
STRUCTURE OF KNOWLEDGE PG.'S 9-lA. 

DEVELOP STRESS MANAGEMENT SKILLS . REF. #7 INSTRUCTOR PILOT 
TEACHING BEHAVIOR AND THE STUDENT PILOT STRESS IN FLIGHT 
TRAINING. ALL. 

USE CODING CUES IN AN EXERCISE GUIDE TO FORMULATE 
QUESTIONS . REF. #3 EXCERPTS FROM SYNOPSIS OF TAXONOMY OF 
OUESTIONS ALL; SIMUTATOR EXERCISE GUIDE: SOIOC IN 
CONJUNCTION WITH SEMINAR. 

ASSESS ACHIEVEMENT OF CLOSURE THROUGH QUESTIONING . REF. #4 
EXCERPTS FROM SYNOPSIS OF THE TAXONOMY OF OUESTIONS PG. 
6;REF.#3 EXCERPTS FROM SYNOPSIS OF THE TAXONOMY OF OUESTIONS 
ALL. 



3. COACH STUDENTS 

DEFINE THE PURPOSE OF INSTRUCTOR COACHING DURING THE 
PERFORMANCE OF SQIOC. REF. NO REFgRENCE IN READING? SOIOC 
MODEL IN CONJUNCTION WITH SEMINAR. 



ERIC 



3V Q^^ 

iJ f 



• 



SIMULATOR INSTRUCTOR TASK ANALYSIS TRACKING NO. A-4 

DISTINGUISH BETWEEN THE DIFFERENT LEVELS OF COACHING 
IN^/OLVEMENT . REF. HO REFERENCE IN RSADING; 80IOC MODEL IN 
C ONJUNCTION WITH SEMIN2^. 

EXPLAIN HOW AN INSTRUCTOR CAN GENERATE A "STUDENT-INITIATED 
QUESTIONING" AND WHY THIS IS ADVANTAGEOUS . REF . #4 EXCERPTS 
FROM SYNOPSIS OF THE TAXONOMY OF OUESTIONS PG. 4. 

EXPLAIN HOW PROPER COACHING WILL PREVENT OPERATOR (TARGET 
POPULATION) APPREHENSION AND BUILD CONFIDENCE IN 
ACTIONS . REF. SUMMARY PG. 5. 

EXPLAIN HOW THE INSTRUCTOR CAN MINIMIZE STRESS AND MAXIMIZE 
OPERATOR (TARGET POPULATION) PERFORMANCE DURING A SIMULATOR 
EXERCISE. REF. #6 TRAINING FOR SAFETY IN AUTOMATED PERSON- 
MACHINE SYSTEMS PG. 547 

EXPLAIN WHAT IS MEANT BY THE TERM "SYNERGY"' AND "GROUP 
THINK" .R EF. #5 TRAINING OF CONTROL ROOM CREWS IN PLANT 
DISTURBANCE DIAGNOSIS-A METHODOLOGICAL FRAMEWORK PG. 
17. 18. KEEP READING REFERENCE FOR SYNERGYc 

LIST WHAT DIAGNOSTIC SCHEMES CAN BE UTILIZED TO SOLVE PLANT 
PROBLEMS DURING A SIMULATOR EXERCISE. REF. #5 TRAINING OF 
CONTROL ROOM CREWS IN PLANT DISTURBANCE DIAGNOSIS- A 
METHODOLOGICAL FRAMEWORK ALL 

GIVEN A PLANT PROBLEM EXPLAIN WHAT DIAGNOSTIC SCHEME WOULD 
BE USED AND JUSTIFY YOUR ANSWER. REF. #5 TRAINING OF CONTROL 
ROOM CREWS IN PLANT DISTURBANCE DIAGNOSIS-A METHODOLOGICAL 
FRAMEWORK. ALL 

USE SQIOC PROCESS TO DETERMINE THE LEVEL OF COACHING. REF. NO 
READING REFERENCE; 80I0C MODEL IN CONJUNCTION WITH SEMINAR. 

COACH AT THE PROPER TIME WITHOUT IMPEDING FLOW OF EXERCISE 
OR INTERFERING WITH STUDENT OPERATIONS . REF. NO REFERENCE 
READING; EXERCISE GUIDE IN CONJUNCTION WITH SOIOC DURING 
SEMINAR. 

REINFORCE TEAM SKILLS . REF . #5 TRAINING OF CONTROL ROOM CREWS 
IN PLANT DISTURBANCE DIAGNOSIS-A METHODOLOGICAL FRAMEWORK 
PG. 'S 15-20; REF. #6 TRAINING FOR SAFETY IN AUTOMATED PERSON- 
MACHINE SYSTEMS ALL 

DEVELOP STUDENT DIAGNOSTIC ABILITIES. REF. #5 TRAINING OF 
CONTROL ROOM CREWS IN PLANT DISTURBANCE DIAGNOSIS- A 
METHODOLOGICAL FRAMEWORK PG.'S 15-20. 
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SIMULATOR INSTRUCTOR 



TASK ANALYSIS 



TRACKING NO. A-4 



DEVELOP STUDENT CODING ABILITY . REF. #2 THE NATURE AND 
STRUCTURE OF KNOWLEDGE PG.'S 9-14. 

DEVELOP STRESS MANAGEMENT SKIIJ.S. REF. #6 TRAINING FOR SAFETY 
IN AU^TOMATED PERSON-MACHINE SYSTEMS ALL:REF.#7 INSTRUCTOR 
PILOT TEACHING BEHAVIOR AND STUDENT PILOT STRESS IN FLIGHT 
TRAINING ALL. 

USE INDUCTIVE/ DEDUCTIVE USES OF EXAMPLES. REF. #4 EXCERPTS 
FROM SYNOPSIS OF THE TAXONOMY OF QUESTIONS PG. »S 6.^7. NEED 
MORE REFERENCE MATERIAL. 

FACILITATE ACHIEVING CLOSURE FOR STUDENTS. REF. #4 EXCERPTS 
FROM SYNOPSIS OF THE TAXONOMY OF QUESTIONS PG. 6. 

USE INSTRUCTIONAL CUES . REF. SIMULATOR EXERCISE GUIDE. 

PROVIDE POSITIVE AND CONSTRUCTIVE FEEDBACK ♦ REF . #7 I NSTRUCTOR 
PILOT TEACHING BEHAVIOR AND STUDENT PILOT STRESS IN FLIGHT 
TRAINING PG.595 

USE ROLE PLAY CUES IN EXERCISE GUIDE TO COACH STUDENTS .REF\ 
SI MULATOR EXERCISE GUIDP; SOIOC MODEL IN CONJUNCTION WITH 
SE.IINAR. 

DEVELOP INDIVIDUAL EFFORTS INTO A SYNERGISTIC EFFORT. REFiNO 
REFERENCE IN READING MATERIAL. 



4. INTERVENE TO CORRECT 

DEFINE THE PURPOSE OF INSTRUCTOR "INTERVENTION" DURING THE 
PERFORMANCE OF SOIOC. REF. NO REFERENCE READING 
MATERIAL, SOIOC MODEL IN CONJUNCTION WITH SEMINAR. 

DISTINGUISH BETWEEN THE THREE TYPES OF INTERVENTION 

METHODS . REF. NO REFERENCE READING; SOIOC MODEL IN CONJUNCTION 

WITH SEMINAR. 



DISCUSS THE MEANING OF THE TERM THE OPERATOR IS A" M^iNAGER 
OF SYSTEMS". REF. NO REFERENCE READING, DISGUSPED IN SEMINAR. 



EXPLAIN HOW PROPER INSTRUCTOR INTERVENTION CAN BE PERFORMED 
DURING A SIMULATOR EXERCISE TO PROMOTE THE IDEA AN OPERATOR 
IS A "MANAGER OF SYSTEMS" . REF. NO REFERENCE READING, 
DISCUSSED IN SEMINAR. 
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SIMULATOR INSTRUCTOR 



TASK ANALYSIS 



TRACKING NO. A-4 



EXPLAIN WHY INTERVENTION SHOULD BE USED JUDICIOUSLY DURING A 
SIMULATOR EXERCISE. REF. SUMMARY PG. 4 

EXPLAIN HOW EXCESSIVE INTERVENTION MAY RESULT IN A NEGATIVE 
TRAINING" EXPERIENCE. REF. SUMMARY PG. 5 

RECOGNIZE PERFORMANCE THAT INDICATES A CODING OR COGNITIVE 
ERROR THAT REQUIRES INTERVENTION. REF. NO REFERENCE 
READING ;SOIOC MODEL DURING SEMINAR. 

USE SQIOC PROCESS TO DETERMINE APPROPRIATE INTERVENTION . REF . 
NO RgPERENCE READING; DISCUSSED DURING SEHIN2m WITH 80IOC 
MODEL. 

FOSTER TEAM INTERACTION USING INTERVENTION TECHNIQUES . REF . NO 
REFERENCE READING? DISCUSSED DURING SEMINAR, SOIOC MODEL. 

REINFORCE TEAM SKILLS . REF . #5 TRAINING OF CONTROL ROOM CREWS 
IN PLANT DISTURBANCE DIAGNOSIS-A METHODOLOGICAL FRAMEWOR K 
PG.'S 15-20; REF. #6 TRAINING FOR SAFETY IN AUTOMATED PERSON- 
MACHINE SYSTEMS ALL. 

ASSESS COGNITIVE SKILLS USING INTERVENTION TECHNIQUE . REF . NO 
REFERENCE READING; DISCUSSED DURING 80I0C MODEL DURING 
SEMINAR. 

DEVELOP STUDENTS DIAGNOSTIC ABILITIES. REF. #5 TRAINING OF 
CONTROL ROOM CREWS IN PLANT DISTURBANCE DIAGNOSIS- A 
METHODOLOGICAL FRAMEWORK PG.'S 15-20. 

DEVELOP STUDENTS CODING ABILITIES. REF. #2 THE NATURE AND 
STRUCTURE OF KNOWLEDGE PG.'S 9-14. 

DEVELOP STRESS MANAGEMENT SKILLS. REF. #6 TRAINING FOR SAFETY 
IN AUTOMATED PERSON-MACHINE SYSTEMS ALL; REF, #7 INSTRUCTOR 
PILOT TEACHING BEHAVIOR AND STUDENT PILOT STRESS IN FLIGHT 
TRAINING ALL. 

RECOGNIZE/ ACT ON SIMULATOR CONDITIONS WHICH DIVERGE FROM 
EXPECTED RESPONSE. REF.no REFERENCE READING; DISCUSSED DURING 
SEMINAR DURING SEMINAR. 

ESTABLISH CONDITIONS AT THE END OF INTERVENTION ROUTINE AND 
CONTINUE EXERCISE. REF. NO REFERENCE READING; DISCUSSED 
DURING SEMINjUl, SOIOC MODEL. 

RECOGNIZE NEGATIVE TRAINING OCCURRING. REF. SUMMARY PG.'S 4.5 

PREVENT/ RECOVER FROM A NEGATIVE TRAINING EXPERIENCE. REF. 
SUMMARY PG. 'S 4.5. 
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SIMULATOR INSTRUCTOR TASK MJALYSIS TRACKING NO. A-4 



KEED TO DEVELOP: (Potential Ideas) 

SIMULATOR INSTRUCTOR PROGRAM MATERIALS TO BE DEVELOPED 

1. ACTIVE LISTENING- READING MATERIALS, INCLUDE IN LESSON PLAN. 

2. PEER & SELF ANALYSIS- NEED READING MATERIAL DEVELOPED, 
ALR.T2ADY INCLUDED IN LESSON PLAN. 

3. HEURISTIC & ALGORITHMIC PROBLEM SOLVING, SOME MATERIAL IN 
READING (SWEDISH PAPER) NEED MORE INFO. 

4. RULE & KNOWLEDGED BASED THOUGHT- NEED SOME SUPPLEMENTAL 
READING, DISCUSSED IN LESSON PLAN. 

5. INQUIRY DEVELOPMENT-- NEED ADDITIONAL INFORMATION, 1 PAGE 
SUMMARY IN READING MATERIALS NOT SUFFICIENT; A VIDEO WOULD 
BE USEFUL. 

6. EXERCISE- NEED TO DEVELOP A EXERCISE FOR THE STUDENTS TO ASK 
YES/NO QUESTIONS TO STIMULATE DIAGNOSTIC SEARCH ROUTINES. 

7. PRE-EXERCISE FLOWCHART- NEEDS TO BE DEVELOPED FOR SEMINAR. 

8. EXERCISE GUIDES- NEED TO DEVELOP MATERIALS TO SHOW STRUCTURE 
OF SDDMS IN CONJUNCTION WITH EXERCISE GUIDE. (DOUG) 

9. VIDEO- SHOWING SQIOC & QUESTIONING TECHNIQUES. 

10. EVALUATIONS- IN PROGRESS DALE IS PUTTING INTO FORMAT. 
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SIMULATOR INSTRUCTOR QUALIFICATION FLOWCHART 
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Qualified to operate 
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SIMULATOR INSTRUCTOR TRAINING PROGRAM 
INITIAL TRAINING 



^KL OBJECTTVE ? 



A-1. Given a simulator, instructor facility (IF), and simulator 
operator instructions, the simulator instructor will operate 
the slBuxator executing an exercise guide sequence or 
running a test. 

A-2. Given an exercise guide, the Simulator Development Database 
Management System (SDDMS) , and required paperwork, the 
simulator instructor will prepare for the exercise; exercise 
materials are reviewed and the simulator set-up. 

A-3. Given any exercise guide, the simulator instructor will 
■ conduct a pre-exercise brief that includes all prescribed 
elements outlined in the exercise guide. 

A-4. Given any student target population and an approved exercise 
guide, the simulator instructor will perfom SQIOC integra- 
ting the four elements, as the exercise permits and the 
students progress. 

A-5. At thfa conclusion of any lab, demonstration or practice 

exercise, the simulator instructor will conduct a critique 
covering all exerc.se guide critique topics, and focusing on 
exercise objectives and performance indicators. 

A-6. Given a specific target population, an approved simulator 
evaluation exercise guide, and Watchstanding Skills Ma- 
trices, the simulator instructor will conduct a student 
evaluation that focuses on the exercise objectives. 

B-1 Given a request for simulator training, a personal computer 
(PC) workstation, and the SDDMS, the simulator instructor 
will analyze the training requirements, producing or 
modifying an Identification Block Diagram (IDBD) . 

B-2 Given a request for simulator training, a PC wordstation and 
appropriate references, the simulator instructor will desigii 
a training exercise; the exercise guide outline (EGO) is in 
the approved format and meets the scope of the request. 

B-3 Given an EGO, the simulator instructor will develop a 
training exercise, the exercise guide (EG) is in the 
approved format, meets the Review Criteria, and is within 
the scope of the EGO. 
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JQIOC INFORMATION PROCESSING RELATIONSHIP 
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Foundations of iQ\nQ 
Human Inf ormation Processfng 

Consideration of human cognitive functioning in the 
development of fQIOC was predicated on the belief that if Sis 
are to enhance CRO training effectiveness, they must not 
only t30 well versed in course content, but must also be 
knowledgeable atxut their intended "audience*. These 
audience characteristics include specific in^xjrmation about a 
student's incoming leve( of knowledge (e.g.. engineering 
technician versus senior reactor operatC/r) as well as some 
general information reganjing the ways in which humans 
acquire, retain, and use knowledge. 



Our discussion is generally based on a recent moae< of 
informatJon processing developed by Wickens (41. but the 
descnptions and graphic representations have been tailored 
»n some cases to be more specifically applicable to JQIOC 
implemantation at FPL (addittonal details of this impiementa. 
twn may be found in Pond. Magennis. and Dedon. (5|. The 
sfa^of human information processing postulated by Wick- 
ens are represented in the lower, unshaded poftkjn of Figure 
1 and the elements of fQIOC depicted m the upper, shaaed 
aroa* 
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For present purposas, the following details should 
provide sufficient background to demonstrate the importance 
of these data for NPP training and to appreciate the role of 
jQIOCin increasing training effectivenese. Sffmir//(that is.the 
information received by our senses) may be transmitted to the 
Percdption stage, where our first awareness of this informa- 
tion occurs. The input channel from Long Term Memory. 
which is our permanent storehouse of knowledge, into the 
Perception stage enables what we have learned in the past to 
influence what we perceive in the present. Additionally, 
perceptions may be influenced by our expectations (which 
are also stored in Long Temi Memory) of which inputs we 
believe to be most likely to occur. Perception may be 
described as the process of associating incoming data with a 
tampiMm from Long Term Memory. Our existing templates 
are modified or new templates created to account for new 
informatjon acquirod (that is. learned"). 

« 

Oeosw«s are then made regarding which infomiatk)n 
may be transmitted to Working Memory for additional proc- 
essing. Generally speaking, placing something in Working 
Memory is akin to Ihinking abouT It Working Memory 
capacity is limited and only those data in active use— that is. 
those to which we are "paying attentksn*— are retained on t*>e 
desk top. Others are either forgotten or sent to/returned to 
Long Term Memory for storage. As shown in Rgure 1. 
Working Memory acts as the waystatioo through vt-hich the 
primary conduits to and from Long Term Memory must pass. 
These corxjuits are magnified in Figure 1 to indicate the 
importance to training of the processes represented. Simply 
stated, the primary goal of training is to aid the acquisition/ 
retentwn^recolIectkDn of information and. therefore, the infor- 
matwn fkjw through these conduits. 

One view of Long Temi MenKryis that it can be divided 
into two storehouses of permanent memory. Pn^^dumJ ' 
memory is organized imo a series of tf-Tnen* statemerrts 
such as If a reactor trip has occurred, then foltow Emergency 
Operating Procedure 1". Declarative memory, is organized 
into a networi< of fact nodes which are connected by relationaJ 
links. Each of these nodes also connects to and is therefore 
assodated with other nodes. The "free associatksn" game in 
which one person says a word and a sea»Kl person says the 
first thing that «mes to mind is a technique for detemfiining an 
individual's node^ink connectfens. and thus provkJes a map 
of tJ^e DeciarzHvB memory component o^ LTM. As will be 
discussed, a SI uses lOlOCing to buiU such a map in order to 
properly diagnose the source of a trainee's d'rffteulty in re* 
spending to some simulated event and to modify fixisting, 
unsuitable links/nodes or to create appropriate new links/ 
nodes. 

Based on the information processing activities in 
Working memory, the Decisionand Response selecHonoi^ 
actions deemed appropriate are transmitted to Response 
execution for enactment. Knowledge gained through this 
process may be retained in Procedural memory. It may also 
be used to build fact nodes and create or strengtfien connect- 
ing links in Declarative memory, and to modify or create 
templates which will be available for later use in Perception as 
well as Working Memory. 



NPP Qoflrqvsfl 

At Ronda Power 4 Ught the design of all simulator 
exerdse material is based on Idenmcation Stock Diagram, 
(IDBDs). All events/conditions se;ected for simulator trains ^ 
are charted by kjentifying the major steps or milestonL 
comprising each -evolutwn". A sequence of these milestones 
beginning with a specific initial set of conditkjns and ending 
with a desired terminating conditfen is called an ID8D. Eacn 
milestone btock of the ID8D is examined to detennine or 
define the relevant infomiation for a number of areas: 



• industry events 

• procedures 

• technjcaJ specificatkjns 

• CRO tasks 

• knowiedge and ability requirements 

• student activities 



As a result of this process, every milestone of every evolution 
may contain reference data of value to the SI. 

This information is used to constnjct an Exercise 
Guide Ocrtffrje which details the milestones and specifies the 
goals to be achieved by students. Upon approval of the 
Outline, the above data are then used to devetop the Exercise 
Gtttdeswhich Sis empkjy in orchestrating simulator sessions. 
These Gukles contain tenuinai (i.e.. product) as well as 
enaW/ng(i.e.. process) oiv'ectfvesfor each evolution. Further, 
the detailed Exercise Guides provkJe behavwrai and Simula* 
tor status indicators which sen^e as cues for the SI to imple- 
ment the various /QIOC technkjues. 




As shown in Rgure 1. and as further detailed in the 
foltowing discussion, there are three interfaces between 
/QIOC and the cognitive processing stages: First. SI gather 
most of their information regarding performance by visu al and 
auditory observation of the student's overt responses. Sec- 
ond, additional infomiatkDn may be Inferred from student 
behsvwrs exhibited prior to or in th« absence of overt re- 
sponses. Finally, all SI inputs— in the form of questioning, 
coaching, or process intervention— are provided to the 
student through Perceptual stzge processing. 



• 



As indkxited. NPP operatkDn typtcally levies relative!, 
light physical/rpotor demands on CROs. Frequently, how 
ever, consklerable information processing— and the atten- 
dant workkjacJ— precedes such simple motor responses as 
turning a key-activated switch. For effective training, a SI 
must be aUe to distinguish between situations in which a 
proper response (product) was based on con^ct knowledge 
and sound logic (process) from that in which this response 
was the serendipitous result of incorrect or incomplete knowl- 
edge and/or faulty togic. While the temiinal objective may be 
attained in each case, if faulty templates/nodes/links are 
reinforced because only product cnteria are used, suose^ 
quent plarrt operations may be jeopardized through ena 
ment of deficient or defective process behaviors. 



o 
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FPU's simulatormstructors. therefore, are trairwd to be 
keen observers and to strategically position themselves dur- 
ing evolutions to gath#r m requisite process indicators. If it 
appears through visual and auditory observation ihat the 
student and/or the team is not properly handling the simulated 
event, a questioning routine is begun. The /QIOC question- 
ing procedure is based on Bloom's Taxonomy of Education^ 
Objectives in the Cognitive Domain[S] which distinguishes six 
levels of cognitive functioning. The Si generates questions at 
the lower-order, knowfe<fge, comprehension, and opptitMicn 
levete to test a student's memory for facts and aries. Higher 
order questions involving analysis, synthesis, and evaluation 
are used to assess an individual's analytical/relational level 
of functioning. Broadly speaking, these tow- and high- order 
questfors may be related to the information represented by 
the Long Term Memory nodes and links, raspeutiveiy. 

In many cases, this questioning process selves as a 
hint or a guide to proper CRO operation. Failing this, how- 
ever, the SI uses the student's responses to diagnose \i\e 

source oftheproblem--faultyormissing fact /xx^asorrelationaj 
//nAc5-^d attempts through coaching to lead the operator/ 
team towards the propw' solution path. Such coaching may 
entail prompting with specific information, hinting at assoda- 
tions. or use of the Socratic Method throiigh which students 
are led towards discovery of solutions by a seriss of questio ns 
from the SI. 

If. despite coactiing, the CRO^eam is still unable to 
effectively deal with tha evolution, the SI will elect to inten/ena. 
In JQIOC there are three levels of intervention based on the 
degree to which the individual or team is removed from the 
real-ti.me simulated event As indteated in Rgure Z the least 
invasive level is tenned a Afenfa/ inten^ntion and it repre- 
sents a studenTs brief cognitive departure from the evolution 
to, for exampk*, contemplate and respond to a Si's question- 
ing or coacf ung. 

More severe is a Phys/ca/ intervention in whtoh a SI 
enters the sin.jlation scenario and prohibits a student from 
taking a partk:ular action. There is a school of thought that 
would, for example, alk>w a student to violate an interlock in 
order to teach him a lesson through the consequences suf- 
fered. At St Lude, however, the student woukj be stopped 
from taking this action in order to reinforw the FPL policy of 
never intentionally challenging interlocks on operational 
equipment In infonnatwn processing tenns. we prevent the 
building ot improper links. Rnally. Big Picture interventions 
are aborted evolutions in which the simulation is frozen. This 
may be called for if a team has mis-diagnosed an event or rf 
the -big picture* plant status is tost by the team as they attempt 
to remedy smaller, kxalized faults and. of course, if question- 
ing and coaching have failed tc get the evolution back on 
track. 

/QIOC is a dynamto. interactive technique which adapts 
to the needs of each individual/team. In Figure 2. the tower 
right hand comer~or bottom aing of the ladderwepresents 
an individual with the plant experience of. say, an inrtiaJ 
license operator. For someone at this relativelv low level of 
operational sophistication, the SI should utilize a micm level 



of obsen/ation m which each specrfx: behavior fs scrutinized 
Tt^questo^^ 

edge) questions, and may require a significant amount of 
coaching. Frequent simulation freezes may be necessary to 
assure that students maintain awareness of the big acture 
event. ^ ^^^i^f^ 

Figure 2 also depicts the relative frequency of the 
vanous JQIOC elements appropnate for sessions with more 
highly skilled operators such as those upgrading to senior 
reactor operator. At the upper end of this expenence fadcer 
as. for example, with requalifying senior reactor operators) 

IQiOCing is more typicailycharactenzedbymacro{l.e..broad 
perspective) obser/ations. highsxder questtons, minimal 
coaching, and brief. Mental interventions. Finally, this same 
progression ^up the ladder- with increased experience/skill is 
evident as well within training modules. 

The anchor or focus for the SI is the FPL Watch-- 
standing Skills Matrix. This document details the cntical 
watchstanding process behaviors v^rfiich have been qrouoed 
and labeled as: 

• control board awareness 

• corrtrol board manipulations 

• use of procedures 

• use of techntoaJ specifications 

• use of reference data 

• communications 

• team skills 

• event diagnosis 

Each critical behavtor is supported by a number of obsen/- 
able, supporting actions, the absence or presence of which 
enable categorization of CRO^eam perfomiance as 
Un;^atisfactory, Satisfactory, or Srperf in nature. 

Concisely stated, the Exarcisa Guide alerts the SI to 
. approaching behavioral/performance milestones during each 
evolution. The SI implements and adjusts his \QlOCing 
technk^ues to aid/gukle the control room crew through these 
milestones, and he then assesses indivklual and team per- 
formance in light of the criteria specified in the Watchstandina 
Skills Matrix. ^ 



fQIQC Status 

To date, 1 9 Sis in 2 classes have been trained in the 
JQIOC technkjues. Their response has been very favorable 
afKj SI comments have been incorporated into successive 
revistons of the program. Considerable team spirit and 
enthusiasm are seen in Sis who have completed jQlOC 
training. Being a •/OlOCer* is viewed as a badge of honor and 
"JQlOCing* is often used as a pre-simulation session rallying 
cry among Sis. 

Corrtrol Room Supervisors and Shift Supen/isors were 
able to easily identify with the /QIOC process because many 
were already employing these techniques with their operaong 
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WATCHSTANDINQ SKILLS MATRIX 



FIGURE 2: SQIOC - ADAPTATIONS OVER TIME 
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crews— alb«ri m a i«s structured and effective manner than 
is possible wrtti jQIOC. Future plans include developing 
JQIOC as a Sentor Reactor Operator sKiil and. therefore, to 
incoipcrate th«ae l^chniques into operational as well as 
simulsted environments. 

The ti-aining activities at Ponda Power & Ught's St. 
Luce fa-:ility are increasingly being foi>jse<l on the range of 
team skills needed :c«- safe, efficient NPP operation. In 
particular, team decsion making ?9chniques and effective- 
ness are areas of continuing effait «or ei^ample. work is in 
progress to define the relevant behaviors associated with 
CRO leadership and f dlowership* styles. These behaviors 
will then be incorporated into »no apprcpriate Exercis© 
Guides-probatjiy as Enabling Objectives-and. givon these 
dau and the structure of the JOiOC process. Sis can devote 
spedaJ attenticn to proper develrpment cf these skills R. 
naily. in addition to the above st/\^c issuos. consideration is 
being given to the significance oi sm^.j[or instnjctor. opera- 
tor/student, and team indMdiuu differsficas in oersonaiiiv. 
Bxpeoenoe. etc. for training antf operrticns effectivaness. ' ' 

Through this combination of research, selection, class- 
room eaucatkjn and simulator practice (irduding /QlOCing) 
FPL hopes to assemble, mold, and train teams of operators 
who will perform effectively under the demanding conditions 
inherent in NPP operation. 



(1J T.8. SherkJan. Understanding human error and aid- 
ing human diagnostic behavior in nuclear power plants ' 
In: J. Rasmussen 4 W.B. Rouse. Human dfltBrtion fmil 
tiiagnosi? of system faihrnn- Kcf» York: Plenum. 1931 

pp. 19-35. 

(2] H.L. Henneman i W.B. Rouse. -Measures of human 
problem solving perfomiance in fault diagnosis tasks.' 
gE£ Transactions on svatama man m ^ritumntiffl, imi 
SMC- 14. ^4o. 1. January/Febnjary 1984. 

(31 K.D. Duncan. Training for fault diagnosis in industrial 
process plant.' In: J. Rasmussen & W.B. Rouse. Human 
detection and diagnosis m «tYntftm Mum New York: 
Plenum. 1981. pp. 553-573. 

(41 CD. Wickans. Enoinaarin^ f^yrfT^f^. f^.^^^^^ 
MrfQfmanCfl- Columbus, oh. 1984. ch. 1. pp. i-i a. 

|51 D.J. Pond. J.A. Magennis. & J.M. Oedon. SimulalflC 
'■liSlnmz tranino oronram: Pm-fiBminar reading matftn '. 

FL Pierce. Fl: Florida Power 4 Ught Compsny. 1988. 

(61 B.S. Bk)om. Taxonomy nf gduealinnal fTt^-^ iyfl^, 
Handtwk I: Coomtivw p<?mi3in New York: David McKay 
Co.. pp. 201-207. ' 
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' OUaIn required pfipersyork 
' SolupSlmu^lOf 



CONDUCT 
PRE-EXERCISE BRIEF 




DELIVcR OVERVIEW 




jgXPLAIMn-EAM WATCHSTANDING SKILLS 



1 ASSIGN SHIFT 


ASSIGNMEHTsj 






1 ASSIGN/EXPLAIN ROLE PLAY \ 






QUESTIONS, CLARIFICATIONS 



L 





115 



• 
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• 



• # • 

ONE METHOD OF CONDUCTING A CRITIQUE COVERING ALL ELEMENTS 




SIMULATOR TRAINlIyfG DEVELOPMENT 
PRODUCTS RbLATIONSHiP 



IDENTlFiCATION 
BLOCK DIAGRAM 



MILESTONES 



LER'S 



SYSTEMS 



PROCEDURES 



1 



KA'S — 
TASK LISTS 
ACTIVITIES 



lo 



EXERCISE GUIDE 
OUTLINE 



MILESTONES 
METHODS - 



■> TOPICS 



OVERVIEW 




GOALS 



EXERCISE GUIDE 



OUTLINE 



INSTRUCTOR 
^ ACTIVITIES 



OBJECTIVES 



^ STUDENT ACTIVITIES 
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SIMULATOR INSTRUCTOR TRAINING 



PROGRAM MAP 




Pr ereQuIsItM 

• SRO Certification or 
License 

• Qualified Licensed 
Operator Instructor 




DEVELOPING TRAINING PROGRAM STEWARD 
SKILLS WITH MODULARIZED MATERIALS. 




SAN ONOFRE NUCLEAR GENERATION SITE 
UNITS 1. 2 S 3 
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Southern California Edison Company 



TRAINING PROGRAM STEWARDSHIP 

Identified Problem 

• 

• ATV Identified Program Concerns 

- Routine Review and Maintenance of 
Training Program Components Lacking 
. Task Lists 

. Task to Training Materials Matrix 
. Training Program Outline 
. Qualification Guides for OJT 

• Found Quality In Training Materials 

- Lesson Plans Technically Accurate 

- Maintained Current With Industry and Plant 
Operating Experience 

• Conclusion: Program Design-Basis Documentation 
Lacked "Stewardship." 
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TRAINING PROGRAM STEWARDSHIP 

Proposed Solution 



• Revise Nuclear Training Division Procedures 

- Identify and Fill Gaps In Business Practices 
Implementation 

- Tighten Administrative Controls To 
Clarify Responsibilities and Accoutability 

• Identify, Train And Assign New Roles To 
Selected Instructors 

- Monitor The Material Condition Of Program 
Components 

- Apply Principles Of SAT Processes 

- Assess Program Status Using Industry Criteria 
For Maintaining Accreditation 

- Document Results 
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TRAINING PROGRAM STEWARDSHIP 
Training Development Process 

• Prepare Job Description 

- Define Roles and Responsibilities 

- QAT Review and Approval 

• Conduct Job Analysis 

- Develop Task List 

- Select Tasks for Training 

9 Conduct Task Analysis 

- Identify Knowledge, Skills, and 
Practical Factors 
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TRAINING PROGRAM STEWARDSHIP 

Training Development Process 

• Design Training Program 

- Establish Training Prerequisites 

- Develop Learning Objectives 

• Develop Training Program/Materials 

- Classroom Lesson Plans (12 hrs) 

- Guided Self-Study-E.U.l.T.C. (32 hrs) 

- Qualification Guide (60 hrs) 

• Implement Training Program 

- Identify Program Stewards 

- Establish Training Schedule 
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TRAINING PROGRAM STEWARDSHIP 
Training Program Components 

• Classroom Training - 12 Hours 

- Roles & Resposnsibilites of Stewards 

- Overview of SAT Principles (B~1) 

- INPO Accreditation Criteria 

• Guided Self-Study (E.U.l.T.C.) - 32 Hours 

- Conduct Job & Task Analysis (A-2) 

- Design Instruction (B-1) 

- Develop Learning Objectives (B-2) 

- Develop Lesson Plans (0-1) 

- Evaluate Trainee Performance (E-2) 

© Qualification Guide - 60 Hours 
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TRAINING PROGRAM STEWARDSHIP 

Training Program Status 

• Program implementation 

- R&R Overview Lesson Presented 4 Xs 

- 46 Instructors (75%) Completed 

- 25 TPS Designated Instructors 

- Training Scheduled for 1990 

• Training Materials Development 

- Lesson Plans: Status 2 

- Self-Study: E.U.l.T.C. Mat'l Available 

- Qual Guide: Approved 
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SONGS INSTRUCTOR TRAINING PROGRAM 

Program Implementation 

• 3 Modes of Program Delivery 

- Classroom Training 

- Guided Self-Study (E.U.l.T.C.) 

- On-The-Job Training/Qualification 

• All Modes Used In 8 Areas of Certification 

- Classrooom/Laboratory Instr Training 

- Training Materials Development 

- Training Program Development (SAT) 

- Computer-Based Training Development 

- Simulator Instructor Training 

- In-Plant Training/Evaluation 

- Instructional Television Development 

- Training Program Stewardship 
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SONGS INSTRUCTOR TRAINING PROGRAM 

Training Outline 

• 3 Phase Training Program 

- Initial Instructor Certification 
. New Instructor Orientation 

. Classroom/Laboratory Instr Training 
. Training Materials Development 

- Continuing Instructor Certifications 
. Training Program Development 

. Computer-Based Training 

. Simulator Instructor Training 

. In-Plant Training/Evaluation 

. Instructional Television Development 

. Training Program Stewardship 

- Annual Continuing Instructor Trng 
. Instructional Skills Development 
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Training Program Stewardship Certification 

Problem 

During a recent INPO T -Accreditation Team Visit at San 
Onofre Nuclear Generat n Site (SONGS) , INPO peer evaluators 
identified deficiencies ^n key components of some of the 
Site's performance-based training programs • Task lists and 
task to training matrix had not been routinely reviewed and 
maintained current with plant and procedure changes, 
industry operating experience, and job scope changes. 
Consequently, job requirements and OJT qualification 
guidelines were incomplete and contained some inaccuracies. 
These problems were characterized by the ATV Manager as a 
"training program stewardship" concern. 

Solution 

Identify, train and assign instructors to monitor the 
material condition of training programs components in their 
discipline using defined criteria for maintaining 
performance-based training programs and the application of 
the Systems Approach to Training (SAT) processes; document 
the results of these program stewardship activities in the 
Annual Program Record Book. 

Training Program Steward Functions 

Verify the status of the assigned Training Program by 
tracking the following functions required by Nuclear 
Training Division (NTD) procedures and SAT activities: 

Program design integrity through routine updates and 
annual validation of the site-specific Task List, Task 
to Training Materials Cross-Ref erence Matrix, OJT 
Qualification Guide(s) , and Training Program Descrip- 
tion (including the training program curriculum). 

Program training material effectiveness through reviews 
and revisions being performed prior to the next time 
taught. 

• Program training evc/Luations conducted at the specified 
intervals. 

Program lessons scheduled and conducted in accordance 
with the content of the Training Program Description. 

Maintain the Annual Program Record Book containing a 
comprehensive file of correspondence, schedules, audits, and 
reports for the assigned Training Program. These records 
shall provide documentation of continuing satisfactory 
stewardship of both accredited and non-acoredited training 
programs . 
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B. 
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C* Advise the Cognizant Training Administrator of the program 
status and identified problems ♦ The Training Program 
Steward shall be the program advocate and lobby for the 
support and assets necessary for the program to meet NTD 
requirements • 

Organizational Relationships 

A* When possible, attend meetings held with the Plant OJT 
Coordinator and Line management associated with their 
assigned Training Program. 

B. Monitor the activities of instructors and support personnel 
in the scheduling and implementation of classroom, 
laboratory, and simulator training for their assigned 
Training Program. 

C. Monitor the av'::tivities of Line personnel, instructors and 
TSSG to ensure the performance basis and technical integrity 
of their assigned Training Program. 

D. Report directly to their Cognizant Training Administrator 
any stewardship concerns associated with their assigned 
Training Program. 

Definitions 

Program Steward: An instructor/SME who has been assigned the 
responsibility to routinely monitor identified components 
and processes associated with specific SONGS training 
programs. The Program Steward is the responsible NTD 
program expert and point of contact for identifying specific 
SAT and procedural/administrative program needs. 

Annual Program Record Book: A chronological record which 

contains the necessary format elements needed to document 
the material condition of a performance-based training 
program in accordance with INPO accreditation criteria, SAT 
standards and NTD procedures. 
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PROGRAM STEWARD 
TRAINING PLAN 



INSTRUCTIONAL TRAINING HOURS DEVELOPMENT 

SETTING " MATERIAL STATUS 

Classroom LP-Roles and 4 0 

Responsibilities 

LP-SAT Overivew 4 1 

LP-INPO Accred 4 2 

Overview 

Totals: 12 

Self Study Electric Industry 

Instructor Training 
Series 

SAT Review 

* (Module Bl,pgs 7-12) 1 2 

Job Analysis 

* (Module A2,pgs 1-48) 2 2 

Selection of Tasks 
for Training - 
Training Level and 

Training Setting i 2 

* (Module Bl,pgs 36-47) 

* Task Analysis 

(Module A2,pgs 49-86) 4 2 

Writing Terminal and 

Enabling Objectives 4 2 

Objectives 

* (Module B2, pgs 1-6G) 

Writing Test Items 4 2 

* (Module El) 

Writing JPM's 4 2 

* (Module E2) 

Course Map-Sequencing 
Objectives 

* (Module B2,pgs 67-78) 1 2 

Course Map-Unit Plan 

* (Module B2,pgs 47-68) 2 2 
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PROGRAM STEWARD 
TRAINING PLAN 



INSTRUCTIONAL 
SETTING 



Qualification 
Guide 



TRAINING HOURS 
MATERIAL 

Lesson Plan 

(Module CI) 4 

Totals: 30 

Application of above 

materials to NTD 

procedures 120 

Totals: 120 

GRAND TOTAL: 162 



DEVELOPMENT 
STATUS 



Module A2 = "Conduct Job and Task Analyses: 

Module Bl = "Design Instruction" 

Module B2 = "Develop Learning Objectives" 

Module CI = "Develop Lesson Plans" 

Module El = "Evaluate Trainee Performance - Knowledge- 
Module E2 = "Evaluate Trainee Performance - Using JPM's" 
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NUCLEAR TRAINING DIVISION ROLES AND RESPONSIBILITIES 



RcQCcroditalion 
Assistant 



Manager 
Nuclear Training 



J. L Reeder 



Secretary 



D.C. Minion, III 



V.>,*0(jst 



M<untonanco 
Adminbtralor 

0. Sheridan 



Supervisor 
Technical Training 



W.ZintI 



HiVCIwm>s!ry 
Admir^tslralor 



C. Doslxom 



Marwgcr's Oversight 
Group 



M.Hyman 
M,Kirby 



Technical Staff 
Administrator 



J.Do(feIt 



Unit 1 0perations 
Adminbtrator 



R Sand Strom 



Supervisor 
OpcralionsTraining 



R J. Metto 



Units 2/3 Operations 
Administrator 



L. Simmons 



Division Office 
Administrator 



S. Murphy 



Simulator 
Administrator 



T.Jomes 



Training System 
Support Administrator 



P.Smith 



Training Administrabon 
Services Administrator 



S.Wylio 



Program Stewards 


B&CMoch. 


Cooko 


Mach. 


Miller 


Welder 


Cooke 


Orano Op. 


Pollock 


rod Crib 


Pollock 


TcstToch. 


Ryan 


ElocL 


Pjontek 


l&C. 




Unit 1 


Powell 


Unit 2/3 


Zadravec 


f^.Mon. 


Bristol 


Comp.Tech. Olmodo 


A/arehouso 


Graves 


i^ofucling 


Olanchard 


iVAC 


Leavitt 


Oti)orlnstructois 


/Vtkins 




Cdoruwso 


McCarroll(OS) 
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Program Stewards 



MP 

DosinfvMry 
Rao'/^aste 
Cl>emistry 
Red Badge 



IVsing 

Rising 

Kutik 

Pressor 

Corey 



OUiorlns'ruclors 
A'JIer 

D'/^igelo(ANA) 

Jcnson 

Noylof 

Sherman 

Spoonemore 

DoFazlo(ANA) 

Dickey 

Dykes 

Patterson 
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Program Stewards 
STA 9Mft 
3on.Tra. Clausen 
foch. Staff Rafner 
Plan/Forman Foster 
FiL for Duly f^bortson 



Other Instructors 
Logor 

Funk (ANA) 
Jennex(GP) 



Program Stewards 
NPEO Koeler 
RO/ACO R>chards 
SRO/CRS Straw 
Roqual Kroeger 



Other Instructors 
Bcntz 

Cusick (OS) 

Kuhner 

Seward 

Sykcs (MDM) 
Wurtt 



l»rogram Stewards 
NP£0 Maisol 
RO/ACO Miller 
SRO/CRS Miller 
Requai Clement 



Other Instructors 



(QUAD) 



Aleyn 
Caldwell 
Chagnon 
Curry (MDM) 
Doily 

Dok:emascolo(MDM) 

Blis 

Grabo 

HaJl 

Kolley 

Kirkpatrick 

Lyke 

f^irron 

Mills 

Rauch 

Schaan 

Seller 

Siannard 

Starr 

Whitley (QUAD) 



P. Lio 
J. Olmos 
R. Rogers 
W Stevenson 



itst/uctk>aalTechnoIogists 



G.ZwissIcr 
O.L'Angelle 
R. Burke 



T 



Program Steward 
Instr.Tro. Freers 



a Calsbock 
O.Gabel 
M^Pettijohn 
0. Sftoomaker 



Media/Graphics 
K. Warren 



M. Allevato 
F. Markham 
C.Sneller 
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5/11/89 

Program Stewards 
Activities to Track 

1. Annual and monthly Training Program schedule including (INPO 
1.7.1 and S0123~XXI-3 . 200) 

o Student attending 

o Lesson plans used 

o Exams given and keys 

o (Ops Regual Steward only) Annual Requal Schedule Plan 
(SO123~XXI-1.303) 



2. Evaluations by: 

o Management direct involvement in training and 
qualification (INPO 1.1.3) 

o Line management providing feedback to enhance training ^ 
(INPO 1.2.1) 

o Training managers and supervisors observing and 
evaluating training (INPO 4.3.1) 



3. Training Material Changes resulting from: 

o In-training evaluations (INPO 4.3.3 and S0123-XXI- 
3.900) 

o Trainee feedback (INPO 4.4.2 and S0123-XXI-3 .900) 

o Former trainee feedback (INPO 4.5.4 and S0123-XXI- 
3.900) 

o Change actions ( regulatory , externa 1 

evaluations/ inspections, INPO guidelines/ good 
practices / plant procedures and system/equipment 
modifications) (INPO 4.6.6 and S0123-XXI-3 . 900) 

o Industr^y operating experience (SOERs, owner groups, NRC 
notification, etc.) (INPO 4.7.1 and S0123-XXI-2 . 150) 

o Plant experience and performance trends (INPO 4.8.2 and 
SO123-XXI-2.150) 



ERLC 



128 



Annual Training Program Record Book 



I. Table of Contents 

II. Oversight Audit Comments 

III. Chronological Record 

IV. Program Course Schedules 

A. Annual 

B. Monthly 

C. Student rosters 



Comments /observations made by 
the Oversight Group during 
routine review 

Narrative list of 
activities/observations 
entered by the Program Steward 



Scheduled 

Actual as taught, including 
lesson plan numbers and 
instructors (for periods that 
training is in progress) 

List of students for each time 
taught 



V. Program Audit Schedule 



Schedule of Annual Task List, 
Matrix, OJT Guide and TPD 
audits 



VI. Process 

A. Changes made to: 



o Task List 

o xiatrix 

o TPD - Curriculum Outline 

o OJT Qualification Manual 



Correspondence/ report/ records 
documenting changes as they 
occur during the year 



B. Annual Task List Review Report of completion 

C. Annual OJT Manual Audit Report of completion 

D. TPD Review Report of completion 
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VII . Content 

A. Training Material Changes resulting from: 
o* In-training evaluations 

o Trainee feedback 

o Former trainee feedback 

o Change actions 

o Industry operating experience 

o Post training feedback from Line supervisors and 
managers 

o Line review of training programs and materials 
(CRCs and TICs) 

o Instructor feedback (IPDEs) 

B. Student Performance measurements 
o Examination results 

o Trainee remedial training 

O Post remedial training re-examination 



VIII. Meeting Minutes 



Only those minutes, or 
sections of minutes, p.ffecting 
the applicable Training 
Program should be retained. 



A. CRC 

B. TIC 

IX. Evaluations (copies) 

A. Management direct involvement 

B. Line management feedback 

C. Training managers and supervisors feedback 

D. Program Evaluation Report (six months after program 
completion) 
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X. 



other 



A. 



AIMS Detailed Status 



All open and closed Action 
Items related to the program 
for the year 



B. 



Audit of Regual Training (Ops Requal only) 



NOTES 



1. Only c* pies of reports /records /correspondence should be 
filed in this Record Book. The original documents shall be 
stored as directed by procedure (Masterfile, CDM, etc.)** 



2, Program Stewards are encouraged to use copies of 
existing documents to meet the needs of this Record Book or 
to recover the required information from common data bases, 
such as TRIMS. 
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ACCREDITATION RENEWAL: AN OVERVIEW 



by 



Ronald L. Fritchley 
Manager 
Accreditation Systems 
National Academy for Nuclear Training 



Mid-West Nuclear Training Association 
Instructor Workshop 

Columbus, Ohio 
October 16-18, 1989 
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ACCREDITATION 
RENEWAL: AN OVERVIEW 

by 

Ronald L- Fritchley 



(Slide 1 - Title Slide) 

0 Good morning! It is a pleasure to be 
here this morning to address this very 
distinguished group 

0 My remarks this morning will focus on the 
following areas: 

Historical background of Academy 
accreditation process: 

Benefits to utility training programs 
as a result of accreditation 

Principal differences between initial 
and renewal accreditation 

Recurring training problems 
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(Slide 2 - Accreditation Background) 

0 Initiated in 1982 as part of INPO's 
responsibility to promote training 
excel l'3nce 

0 Purpose - assist INPO member training 
programs to produce and maintain 
well -qualified and competent work force 

0 Oper&ted under auspices of National 
Academy fo»' Nuclear Training - Academy 
established in 1985 

0 Academy accreditation formally recognizes 
utility training as meeting the 
industry's accreditation objectives and 
criteria - initial and continuing 
training for operations, maintenance, and 
technical personnel 
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(Slide 3 - Benefits to Training) 

0 Industrywide standards (accreditation 
objectives and criteria) established by 
the National Academy - significant input 
and review from the industry 

0 Standards based on principles of 
performance-based training and are 
applied to training programs and not to 
individuals 

0 Accreditation ensures the process is in 
place to prepare the individual to 
independently perform the duties and 
tasks of the job for which he/she 
is being prepared - the utility certifies 
that individuals are ready to perform 
work independently 

0 Systematic evaluation and feedback - 
self-evaluations, program evaluations, 
plant feedback, accreditation team 
visits, and other evaluative inputs - 
provide systematic means for maintaining 
and improving the various training 
programs 

0 Use of INPO and industry peer evaluators 
during accreditation team visits 
provides high quality expertise in 
nuclear power plant operations, 
nuclear utility training, training 
program development and evaluation, and 
instructional processes 
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0 Use of industry peer evaluators on 
accreditation teams has been highly 
successf"! in improving training - has 
led to networking, enhancement of 
community of training professionals, and 
providing each peer with personal 
knowledge and experience on which to draw 

0 Assurance of quality training is 

important to a variety of audiences such 
as plant and line management. Nuclear 
Regulatory Commission, nuclear 
insurance groups, nuclear power plant 
workers, and the general public to 
name a few 

NOTE: Today there are over eight times as 
many individuals working in the area of 
nuclear utility train-^ng as in 1979 (about 
4500). ^ 
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(Slide 4 - Initial and Renewal Differences) 



0 Process for initial accreditation 
consists of self-Gvaluation (and 
self-evaluation report preparation); team 
visit (team report preparation, 
utility actions and utility responses); 
and review and accrer<itation decision by 
the independent National Nuclear 
Accrediting Board. 

0 Acoeditation renewal repeats much of the 
initial accre'' tation process. However, 
assumptions include the accredited 
training programs being maintained at a 
high level and being used to deliver high 
quality training 

0 Renewal objectives and criteria reflect 
increased emphasis on quality day-to-day 
plant line management involvement with 
training 

0 Emphasis is alF.o placed on program 
maintenance through incorporation of 
feedback from various sources such as: 
program use; job incumbents and their 
supervisors; observed performance 
deficiencies; plant and procedure 
changes; pertinent plant and industry 
operating experience; and program 
effectiv ' ?ss evaluations 

0 Licensed operator contnuing training has 
been added as an eleventh accredited 
program 




de 5 - Recurring Training Problems) 

Although the INPO accreditation program 
and the nuclear utility industry have 
enjoyed numerous successes, several 
recurring training problems have been 
identified during accreditation team 
visits and plant evaluations that detract 
from high quality training 

Significant objective or criteria 
deficiencies or an accredited program 
not being useu prompts INPO to initiate a 
review appropriate to the magnitude of 
the problem 

The utility may be asked to demonstrate 
to the National Nuclear Accrediting Board 
why accreditation should continue - 
continue, probation for up to 180 days 
(although cases to date have been for 
only 120 days), or withdraw 
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(Slide 6 - Examples of Recurring Problems) 

0 Training and line management monitoring 
and evaluation of training activities do 
not ensure that key training functions 
are performed and training is conducted 
effectively 

0 Maintenance supervisors are assigning 
personnel to perform maintenance tasks 
independently, without reference to their 
formal qualification status 

0 Some licensed operator continuing 

training progra^^iS have not been revised 

to a performance-based training and 
evaluation format 

0 Several problems with instructor training 
and evaluations have been noted - 
evaluations of technical and 
instructional skills, continuing 
development of technical and 
instructional skills, and using 
instructor evaluation results as a basis 
for continuing instructor development 

0 The process for obtaining post-training 
feedback from former trainees and their 
supervisors has not been effectively 
implemented, and as a result, objective 
or task-based feedback has not been 
collected to improve training 
effectiveness 
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Some training programs in particular, 
maintenance and technical staff/technical 
stdff managers programs have not been 
fully implement (attendance and 
continuting training being two prominent 
deficiences) 
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de 7 - The Bottom Line) 

Ultimate objectives of accreditation are 
to maintain high quality training and 
enhance the professionalism and 
performance of personnel who operate 
nuclear power plants 

The nuclear power industry has accepted 
the responsibility to strive for 
excellence in training its personnel to 
safely operate the power plants - 
the full use of accred'itation and the 
accrediting process by all nuclear 
utilitie. " an important means to 
fulfilling, lis responsibility 




Ronald L Fritchley 

Manager, Accreditation Systems 

National Academy for Nuclear Training 
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Initiated in 1982 



Assist in improving industry training 

Part of National Academy for 
Nuclear Training 



Training for operatic maintenance, 
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a Industrywide standards 



a Training and qualification process 
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initral and Renewal Differences 



ti Initial process 



Renewal assumptions 



Renewal emphasis 




programs 
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g i raining 




Objective or criteria deficiencies 
Non-use of accredited program 
INPO review and follow-up 
Aecreditjng Board pptions 
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as Training and line management invoivement 

SI Maintenance worI< assignments 

^ Continuing training for licensed operators 

Instructor training and evaluation 
■ P6st4rainin| feedback 
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Maintain high quality training 

Enhance professionalism and performan.:e 

Strive for excellence in training plant 
personnel 
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